-- Logs begin at Fri 2022-09-23 00:26:38 UTC, end at Fri 2022-09-23 01:53:09 UTC. -- Sep 23 01:20:04.860795 dv-cinder-849143-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 01:20:04.869919 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 01:20:04 2022] *** Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: nodename: dv-cinder-849143-7-iscsi Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: machine: x86_64 Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: clock source: unix Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: pcre jit disabled Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: detected number of CPU cores: 4 Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: current working directory: / Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: detected binary path: /usr/bin/uwsgi-core Sep 23 01:20:04.871980 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: your processes number limit is 47680 Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: your memory page size is 4096 bytes Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: detected max file descriptor number: 2048 Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: lock engine: pthread robust mutexes Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: thunder lock: enabled Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 01:20:04.872950 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 01:20:04.911860 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: Python main interpreter initialized at 0x559ca924b9c0 Sep 23 01:20:04.911860 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: python threads support enabled Sep 23 01:20:04.911860 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: your server socket listen backlog is limited to 100 connections Sep 23 01:20:04.911860 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: your mercy for graceful operations on workers is 90 seconds Sep 23 01:20:04.912291 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 01:20:04.912291 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: *** Operational MODE: preforking *** Sep 23 01:20:04.912573 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: *** uWSGI is running in multiple interpreter mode *** Sep 23 01:20:04.912573 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: spawned uWSGI master process (pid: 106445) Sep 23 01:20:04.912803 dv-cinder-849143-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 01:20:04.913976 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: spawned uWSGI worker 1 (pid: 106446, cores: 1) Sep 23 01:20:04.913976 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: spawned uWSGI worker 2 (pid: 106447, cores: 1) Sep 23 01:20:04.913976 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 01:20:05.585236 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 01:20:05.591969 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 01:20:06.696499 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:20:06.696499 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: from cryptography.utils import int_from_bytes Sep 23 01:20:06.697138 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:20:06.697138 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: from cryptography.utils import int_from_bytes Sep 23 01:20:06.697585 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:20:06.697585 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: from cryptography.utils import int_from_bytes Sep 23 01:20:06.698005 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:20:06.698005 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: from cryptography.utils import int_from_bytes Sep 23 01:20:09.221890 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:20:09.222570 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:20:09.222981 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:20:09.223081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:20:09.223165 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:20:09.223248 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:20:09.223316 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:20:09.223392 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:20:09.223465 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:20:09.223532 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:20:09.223753 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.223911 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.224025 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.224389 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.224549 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.224715 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.224843 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225039 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225179 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225371 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225652 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225825 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.225972 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226118 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226259 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226521 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226670 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226818 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.226950 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.227083 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.227343 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.227445 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-7-iscsi {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.227692 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-7-iscsi {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.227882 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228014 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228114 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228321 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228418 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228637 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228802 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.228950 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229093 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229255 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229364 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229569 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229674 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.229872 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.230067 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.230403 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.230557 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.230677 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.230854 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231033 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231213 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231390 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231598 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231762 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.231918 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.232110 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.232292 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.232514 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.232722 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.232929 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.233121 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.233317 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.233520 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.233729 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.233938 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234136 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234136 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-7-iscsi {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234486 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-7-iscsi {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234597 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234710 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.234843 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.235052 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.235747 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.235943 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.236157 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.236478 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.236683 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.236866 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.237048 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.237225 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.237435 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.237617 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.237813 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.238006 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.238206 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.238405 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.238623 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.238833 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.239025 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.239212 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.239596 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.239807 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.240007 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.240216 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.240419 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.240615 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.240809 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241015 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241198 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241541 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241748 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.241941 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.242150 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.242356 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.242568 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.242766 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.242951 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.243169 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.243366 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.243631 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.243829 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.244028 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.244224 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.244444 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.244648 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.244861 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.245063 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.245262 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.245472 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.245670 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.245870 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.246073 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.246261 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.246468 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.246664 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.246865 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.247059 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.247254 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.247465 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.247737 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.247937 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.248133 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.248336 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.248544 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.248745 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.248956 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249131 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249283 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249502 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249641 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249778 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.249941 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250068 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250203 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250330 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250466 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250635 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250789 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.250930 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251085 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251217 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251350 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251491 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251693 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251836 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.251970 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252120 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252248 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252403 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252539 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252684 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252814 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.252814 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253086 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253232 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253383 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253518 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253654 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253781 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.253910 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254054 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254205 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254343 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254488 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254634 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254771 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.254896 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255027 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255153 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255259 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255355 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255446 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255523 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255644 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255728 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255822 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.255921 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256006 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256148 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256264 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256387 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256510 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256617 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256737 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256863 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.256993 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257126 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257236 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257341 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257474 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257599 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257722 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257846 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.257969 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258101 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258227 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258355 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258465 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258590 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258715 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258847 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.258972 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259095 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259203 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259326 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259450 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259624 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259753 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.259892 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260030 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260164 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260290 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260429 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260565 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260858 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.260997 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261123 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261269 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261410 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261546 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261672 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261808 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.261936 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262157 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262288 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262426 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262564 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262696 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262696 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.262942 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263079 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263220 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263346 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263472 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263637 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263775 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.263909 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264034 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264159 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264292 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264421 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264548 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264673 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264673 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.264914 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265040 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265173 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265313 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265446 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265573 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265698 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265841 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.265977 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266111 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266238 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266361 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266475 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266597 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266731 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266857 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.266989 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267133 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267260 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267423 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267619 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267760 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.267900 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.268026 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.268159 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.268294 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.268427 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.268553 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.268676 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:20:09.268801 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.268926 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269062 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269190 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269314 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269437 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269561 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269685 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269809 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.269934 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270068 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270193 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270330 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270464 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270601 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270727 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270861 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.270986 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271110 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271243 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271368 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271500 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271500 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271777 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.271926 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272073 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272201 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272325 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272463 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272600 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272740 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.272879 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273008 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273168 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273296 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273421 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273547 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273681 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.273816 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274001 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274206 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274366 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274522 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274729 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274870 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.274999 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.275141 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.275288 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.275426 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.275665 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.275835 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276024 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276202 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276390 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276584 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276781 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.276971 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.277140 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.277269 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.277423 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.277644 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.277823 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278014 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278207 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278387 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278593 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278782 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.278962 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279150 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279352 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279488 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279636 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.279918 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280043 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280182 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280316 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280476 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280590 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280709 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280840 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.280966 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.281102 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.281243 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.281405 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.281551 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.281678 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282299 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282431 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282698 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282828 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.282962 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283099 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283306 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283436 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283613 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283744 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283853 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.283959 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284079 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284238 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284358 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284549 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284683 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.284922 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285071 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285246 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285374 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285641 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285771 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.285958 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.286100 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.286281 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.286412 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.286646 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.286777 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287013 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287151 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287335 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287463 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287763 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.287893 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288082 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288213 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288428 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288558 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288741 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.288879 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.289050 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.289182 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.289376 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.289649 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.289805 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.290403 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.290551 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.290680 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.290807 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.290932 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.291932 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.292126 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.292279 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.292407 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.292956 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.293089 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.293215 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.293350 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.293486 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.294376 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.294493 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.294647 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.294762 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.294879 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.295568 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.295686 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.295807 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.295917 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.296759 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.296891 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.297033 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.297162 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.297288 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.297413 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298073 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298206 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298331 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298456 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298595 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298724 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298860 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.298971 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299100 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299227 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299352 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299485 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299640 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299770 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.299903 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300029 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300154 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300268 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300402 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300529 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300654 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300778 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.300902 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301026 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301160 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301160 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301408 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301535 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301659 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301792 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.301932 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302059 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302185 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302311 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302437 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302710 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302838 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.302964 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303238 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303377 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303503 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303645 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303771 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303896 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.303896 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304156 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304282 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304443 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304580 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304690 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304824 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.304950 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305075 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305190 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305297 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305422 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305557 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305683 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305816 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.305984 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306228 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306480 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306604 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306728 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306861 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.306976 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307145 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307284 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307422 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307663 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307778 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.307900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308030 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308164 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308290 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308398 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308530 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308666 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308792 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.308917 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309031 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309148 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309276 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309415 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309550 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309677 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309802 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.309927 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310052 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310191 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310319 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310432 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310555 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310682 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310817 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.310944 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311070 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311217 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311345 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311471 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311635 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311767 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.311892 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312024 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312134 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312260 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312394 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312528 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312654 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.312914 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313070 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313286 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313416 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313541 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313790 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.313916 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314050 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314177 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314311 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314438 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314706 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.314882 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315197 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315327 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315529 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315760 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.315893 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316028 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316190 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316315 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316439 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316591 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316726 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.316858 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317044 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317249 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317405 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317563 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317712 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.317997 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318150 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318308 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318465 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318621 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318769 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.318945 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.319127 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.319362 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.319527 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.319830 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.319990 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320141 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320293 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320454 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320638 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320787 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.320933 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321107 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321260 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321416 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321582 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321729 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.321876 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322032 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322183 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322373 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322539 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322687 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.322854 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323004 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323158 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323158 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323458 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323629 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323780 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.323929 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324075 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324075 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324379 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324379 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324659 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324813 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324960 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.324960 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325285 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325447 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325625 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325625 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325973 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.325973 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.326271 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.326421 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.326625 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.326788 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.326944 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327092 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327254 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327428 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327628 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.327935 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328082 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328381 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328531 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328694 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.328887 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.329036 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.329189 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.329350 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.329507 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.329672 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330067 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330215 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330510 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330683 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330850 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.330999 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331146 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331292 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331292 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331669 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331669 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.331978 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332125 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332272 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332418 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.332871 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333058 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333256 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333427 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333575 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.333895 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334060 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334060 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334348 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334495 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334646 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334794 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.334956 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335111 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335267 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335414 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335593 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335768 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.335990 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336139 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336286 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336433 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336592 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336792 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.336956 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.337123 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.337302 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.337476 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.337648 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.337885 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338037 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338184 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338331 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338485 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338633 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338789 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.338943 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339119 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339267 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339415 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339672 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339840 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.339990 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340141 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340298 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340454 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340604 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340777 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.340959 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341113 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341272 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341424 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341584 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341584 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.341881 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342032 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342416 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342584 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342737 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.342888 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343045 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343209 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343361 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343527 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343716 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.343867 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.344016 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.344193 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.344856 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345023 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345182 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345332 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345481 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345635 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345806 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.345981 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346132 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346281 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346431 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346588 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346750 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.346925 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347082 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347245 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347403 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347601 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347810 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.347962 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348110 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348257 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348405 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348564 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348720 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.348868 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349024 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349180 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349329 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349487 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349651 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349814 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.349964 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350112 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350269 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350430 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350580 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350728 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.350882 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351058 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351228 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351389 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351541 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351772 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.351964 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352116 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352276 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352428 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352586 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352739 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.352890 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353041 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353200 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353358 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353509 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353670 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353829 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.353980 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354139 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354291 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354442 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354623 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354776 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.354927 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355087 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355238 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355390 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355588 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355754 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.355921 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356100 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356268 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356454 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356627 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356793 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.356970 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357135 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357308 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357468 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357624 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357791 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.357977 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358135 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358282 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358429 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358575 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.358878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359027 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359181 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359328 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359474 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359700 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.359863 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.360617 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.360770 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.360918 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361083 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361266 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361426 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361581 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.361886 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362039 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362197 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362350 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362564 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362742 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.362899 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363047 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363204 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363351 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363496 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363673 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363836 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.363999 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364149 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364296 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364443 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364588 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364741 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.364899 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365046 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365232 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365384 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365539 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365687 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.365842 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366026 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366191 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366354 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366502 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366649 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366809 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.366958 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367104 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367249 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367416 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367617 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367786 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.367954 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368124 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368271 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368419 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368650 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368798 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.368988 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369146 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369294 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369441 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369596 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369743 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.369897 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370083 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370235 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370386 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370543 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370717 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.370881 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371092 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371269 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371440 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371622 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371772 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.371920 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372066 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372211 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372368 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372525 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372673 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372820 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.372972 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.373149 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.373305 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.373452 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.373636 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.373810 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374000 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374149 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374305 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374453 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374600 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374755 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.374903 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375054 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375216 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375364 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375510 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375691 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.375850 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376012 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376160 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376321 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376488 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376644 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376802 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376969 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.376969 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.377282 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.377456 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.377609 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.377755 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.377755 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378061 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378235 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378382 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378528 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378675 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378832 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.378832 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379126 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379272 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379418 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379604 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379604 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.379893 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380039 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380039 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380354 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380517 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380517 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380795 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380948 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.380948 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381401 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381570 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381717 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381717 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.381996 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.382169 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.382169 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.382559 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.382708 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.382708 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383002 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383165 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383323 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383469 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383655 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.383832 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.384066 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.384376 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.384607 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.384797 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.384981 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.385168 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.385369 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.385540 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.385698 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.385909 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.386132 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.386298 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.386531 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.386704 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.386875 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.387165 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.387365 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.387576 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.387812 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.388157 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.388350 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.388603 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.388806 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.389004 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.389202 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.389399 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.389617 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.389824 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.390017 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.390209 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.390403 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.390605 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.390810 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.391005 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.391785 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.391983 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.392248 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.392439 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.392656 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.392857 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.393049 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.393245 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.393481 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.393673 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.393904 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.394084 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.394281 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.394491 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.394679 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.394882 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.395094 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.395287 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.395536 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.395536 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.395962 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.396172 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.396172 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.396537 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.396726 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.396926 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.397125 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.397331 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.397528 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.397730 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.397943 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398351 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398351 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398752 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398946 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.398946 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.399315 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.399531 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.399531 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.399975 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.400175 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.400175 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.400551 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.400775 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.400775 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.401153 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.401352 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.401549 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.401785 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.401942 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.402185 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.402390 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.402552 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.402881 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.403021 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.403170 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.403480 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.403713 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.403842 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.404175 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.404330 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.404490 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.404792 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.404984 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.405172 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.405360 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.405560 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.405798 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.406000 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.406184 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.406381 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.406569 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.406758 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.407599 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.407750 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.407919 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.408229 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.408367 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.408515 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.408829 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.409036 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.409241 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.409440 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.409652 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.409850 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.410011 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.410184 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.410398 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.410607 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.410816 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.411051 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.411247 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.411443 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.411693 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.411891 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.412121 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.412332 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.412509 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.412684 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.412850 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413027 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413231 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413413 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413584 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413755 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.413945 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.414141 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.414348 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.414571 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.414770 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.414970 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.415161 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.415368 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.415613 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.415814 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.416030 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.416227 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.416422 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.416681 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.416936 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417130 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417130 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417534 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417729 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417729 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.417998 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.418125 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.418297 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.418452 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.418633 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.418954 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.419126 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.419266 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.419588 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.419737 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.419911 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.420274 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.420455 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.420592 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.420837 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.420982 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.421186 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.421506 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.421649 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.421799 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.422097 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.422236 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.422409 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.422705 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.422835 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.423709 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.423852 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.423996 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.424188 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.424443 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.424575 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.424811 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.425038 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.425171 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.425459 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.425599 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.425780 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.426092 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.426308 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.426438 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.426705 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.426834 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.427273 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.427408 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.427604 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.427910 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.428053 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.428250 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.428505 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.428636 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.428876 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.429111 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.429252 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.429507 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.429712 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.429852 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.430106 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.430293 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.430424 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.430706 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.430873 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.431013 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.431320 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.431478 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.431652 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.431956 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.432084 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.432273 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.432580 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.432709 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.433142 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.433272 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.433496 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.433823 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.433975 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.434143 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.434409 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.434534 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.434778 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.434960 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.435090 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.435340 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.435481 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.435716 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.435862 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.436057 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.436341 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.436469 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.436651 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.436955 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.437099 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.437259 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.437570 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.437708 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.437874 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.438205 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.438342 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.438511 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.438815 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.438939 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.439142 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.439445 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.439620 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.439764 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.440064 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.440196 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.440379 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.440677 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.440874 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441064 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441250 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441444 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441635 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441817 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.441978 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.442129 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.442262 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.442446 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.442687 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.442911 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.443102 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.443302 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.443470 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.443708 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.443930 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.444125 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.444330 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.444688 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.444923 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.445116 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.445291 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.445556 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.445707 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.445897 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.446149 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.446310 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.446472 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.446749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.446885 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.447102 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.447319 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.447708 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.448048 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.448180 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.448367 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.448661 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.448846 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449017 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449264 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449394 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449621 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449863 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.449993 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.450238 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.450455 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.450587 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.450848 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.451092 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.451235 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.451456 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.451716 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.451850 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.452087 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.452340 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.452484 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.452694 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.452971 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.453117 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.453296 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.453604 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.453797 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.454527 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.455127 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.455331 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.455499 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.455675 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.455938 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.456113 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.456280 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.456458 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.456685 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.456878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.457061 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.457309 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.457496 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.457691 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.457921 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.458110 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.458285 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.458526 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.458695 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.458870 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.459162 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.459334 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.459509 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.459804 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.459980 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.460436 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.460626 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.460830 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.461026 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.461202 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.461464 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.461653 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.461846 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.462086 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.462288 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.462518 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.462713 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.462919 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.463124 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.463317 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.463513 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.463801 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.463997 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.464212 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.464422 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.464618 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.464814 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465015 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465235 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465443 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465635 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465814 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.465949 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.466124 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.466253 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.466415 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.466722 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.466852 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.467027 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.467338 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.467480 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.467669 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.467977 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.468118 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.468283 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.468588 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.468728 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.468891 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.469189 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.469529 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.469666 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.469834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.470139 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.470280 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.470452 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.470742 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.470933 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.471132 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.471308 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.471487 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.471728 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.471977 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.472187 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.472409 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.472618 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.472808 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.472997 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.473180 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.473375 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.473598 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.473799 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474039 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474227 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474349 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474520 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474680 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.474870 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475062 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475291 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475464 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475630 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475762 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.475945 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476083 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476209 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476483 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476618 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476618 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.476897 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477033 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477160 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477300 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477429 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477555 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477685 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477813 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.477922 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478063 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478191 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478316 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478432 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478557 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478696 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478831 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.478959 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479121 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479255 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479380 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479522 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479754 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.479894 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480022 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480149 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480274 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480413 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480550 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480677 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480811 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.480939 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481079 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481214 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481374 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481502 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481630 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.481951 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482145 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482283 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482455 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482585 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482765 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.482906 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483075 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483207 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483386 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483514 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483723 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.483866 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484035 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484174 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484347 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484477 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484660 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.484795 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.485608 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.485818 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.486019 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.486215 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.486436 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.486634 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.486832 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.487027 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.487235 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.487429 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.487677 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.487677 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.488047 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.488253 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.488453 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.488643 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.488898 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.489105 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.489303 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.489511 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490039 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490245 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106446) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:20:09.490444 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490444 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490444 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490444 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.490444 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.491335 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.491335 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.491743 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.491984 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.492331 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.492665 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.492975 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.493281 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.493591 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.493917 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.494229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.494573 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.494856 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.495167 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.495476 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.495865 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.496117 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.496427 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.496736 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.497143 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.497424 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.497690 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.497998 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.498309 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.498627 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.498978 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.499301 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.499644 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.499964 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.500281 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.500658 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.501477 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.501790 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.502101 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.502416 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.502748 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.503063 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.503369 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.504239 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.504481 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.504822 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.505149 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.505463 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.505790 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.506150 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.506414 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.506739 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.507104 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.507387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.507810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.508142 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.508470 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.508778 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.509088 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.509393 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.509706 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.510034 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.510344 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.510647 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.510955 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.511268 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.511596 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.511910 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.512221 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.512525 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.512838 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.513145 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.513448 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.513787 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.514093 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.514399 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.514710 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.515022 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.515327 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.515662 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.515970 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.516373 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.516647 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.516945 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.517277 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.517597 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.517928 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.518246 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.518642 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.518895 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.519192 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.519601 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.519912 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.520224 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.520560 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.520874 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.521192 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.521508 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.521819 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.522130 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.522442 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.522782 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.523114 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.523422 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.523779 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.524094 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.524418 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.524748 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.525062 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.525393 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.525706 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.526009 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.526469 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.526689 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.526926 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.527246 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.527620 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.527911 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.528233 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.528550 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.528884 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.529211 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.529522 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.529849 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.530176 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.530529 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.530846 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.531204 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.531532 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.531918 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.532237 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.532548 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:20:09.532790 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106447) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:20:09.649575 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO dbcounter [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Registered counter for database nova_api Sep 23 01:20:09.669987 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_db.sqlalchemy.engines [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.677671 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writer thread running {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.689313 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO dbcounter [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Registered counter for database nova_api Sep 23 01:20:09.711275 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_db.sqlalchemy.engines [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.718042 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writer thread running {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.736936 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.context [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),365480e9-a6c8-4545-aa74-07b831267c7c(cell1) {{(pid=106446) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 01:20:09.740813 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:20:09.741337 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:20:09.742916 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:20:09.743681 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:20:09.744130 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:20:09.746132 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:20:09.748290 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO dbcounter [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Registered counter for database nova_cell0 Sep 23 01:20:09.752607 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO dbcounter [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Registered counter for database nova_cell1 Sep 23 01:20:09.760888 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_db.sqlalchemy.engines [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.762104 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_db.sqlalchemy.engines [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.768425 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writer thread running {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.771585 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writer thread running {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.776747 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.context [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),365480e9-a6c8-4545-aa74-07b831267c7c(cell1) {{(pid=106447) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 01:20:09.780836 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:20:09.781302 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:20:09.783486 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:20:09.784326 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:20:09.784780 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:20:09.786848 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_concurrency.lockutils [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106447) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:20:09.788984 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO dbcounter [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Registered counter for database nova_cell0 Sep 23 01:20:09.793473 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO dbcounter [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Registered counter for database nova_cell1 Sep 23 01:20:09.803012 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_db.sqlalchemy.engines [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.806176 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_db.sqlalchemy.engines [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.810179 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writer thread running {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.925901 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO dbcounter [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Registered counter for database nova_cell0 Sep 23 01:20:09.933105 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_db.sqlalchemy.engines [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106446) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.938479 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writer thread running {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.950179 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writer thread running {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:09.961079 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO dbcounter [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Registered counter for database nova_cell0 Sep 23 01:20:09.971217 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG oslo_db.sqlalchemy.engines [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106447) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:20:09.976334 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writer thread running {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:20:10.396808 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: WARNING keystonemiddleware.auth_token [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:20:10.404148 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: WARNING keystonemiddleware.auth_token [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:20:10.448007 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: WARNING keystonemiddleware.auth_token [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:20:10.456504 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: WARNING keystonemiddleware.auth_token [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:20:10.756308 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: WARNING keystonemiddleware.auth_token [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:20:10.763758 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: WARNING keystonemiddleware.auth_token [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:20:10.770228 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ca924b9c0 pid: 106446 (default app) Sep 23 01:20:10.772600 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:20:10.773956 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002077 Sep 23 01:20:10.775419 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Fri Sep 23 01:20:10 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:20:10.836037 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: WARNING keystonemiddleware.auth_token [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:20:10.843092 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: WARNING keystonemiddleware.auth_token [None req-98eb1a47-0cff-4711-9319-800b435db160 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:20:10.849154 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ca924b9c0 pid: 106447 (default app) Sep 23 01:21:54.906529 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:21:54.907540 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Sep 23 01:21:54.907983 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:21:54.922013 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_api:SELECT=3 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:54.923826 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_cell1:SELECT=3 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:54.924690 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_cell0:SELECT=3 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:54.927229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:21:56.137033 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-da4f9a63-7bc7-42e7-be41-284ab5831c69 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:21:56.181052 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-da4f9a63-7bc7-42e7-be41-284ab5831c69 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.263877 Sep 23 01:21:56.182552 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1292 bytes} [Fri Sep 23 01:21:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:21:59.999908 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:00.000779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-40fb1899-4c5c-4b46-82b1-ba17fde5ed44 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Sep 23 01:22:00.005488 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:21:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:00.695159 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-f3d221b7-c602-4755-bb9e-b581e946374f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "vcpus": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:00.859567 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-f3d221b7-c602-4755-bb9e-b581e946374f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.849248 Sep 23 01:22:00.860636 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:01.317785 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-e997eaa2-28a2-4196-8741-b0d8c8bd7a24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:01.329798 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=3 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:01.331773 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_cell0:SELECT=3 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:01.332952 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_cell1:SELECT=3 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:01.334147 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:01.528181 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-e997eaa2-28a2-4196-8741-b0d8c8bd7a24 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.652974 Sep 23 01:22:01.529470 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1336 bytes} [Fri Sep 23 01:22:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:04.758169 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-f3d221b7-c602-4755-bb9e-b581e946374f admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:04.759233 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-f3d221b7-c602-4755-bb9e-b581e946374f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Sep 23 01:22:04.759758 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:05.559096 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-64e774c5-96be-4545-a357-55cd479fcf67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:05.751240 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-64e774c5-96be-4545-a357-55cd479fcf67 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.984205 Sep 23 01:22:05.751934 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:05.765024 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-6b9548d8-4b40-4f50-b1fb-d84ac9444b1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:05.978670 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-6b9548d8-4b40-4f50-b1fb-d84ac9444b1f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.218090 Sep 23 01:22:05.979649 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1336 bytes} [Fri Sep 23 01:22:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:09.625464 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-64e774c5-96be-4545-a357-55cd479fcf67 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:09.627711 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-64e774c5-96be-4545-a357-55cd479fcf67 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002996 Sep 23 01:22:09.628488 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:10.370654 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-fc939266-deea-4d07-8b0b-4d2e82fbc6c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "ram": 1024, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:10.473575 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-fc939266-deea-4d07-8b0b-4d2e82fbc6c9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.834406 Sep 23 01:22:10.474529 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:22:10.495574 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-311bfe7e-16a1-48be-a9db-473d648e2837 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:10.601104 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-311bfe7e-16a1-48be-a9db-473d648e2837 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112317 Sep 23 01:22:10.601963 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1336 bytes} [Fri Sep 23 01:22:10 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:14.835915 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-fc939266-deea-4d07-8b0b-4d2e82fbc6c9 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:14.839541 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-fc939266-deea-4d07-8b0b-4d2e82fbc6c9 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004142 Sep 23 01:22:14.840362 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:15.605188 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-db974020-8a7e-408d-9e7b-f2dc30271b62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "id": "d3", "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:15.754587 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-db974020-8a7e-408d-9e7b-f2dc30271b62 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.905308 Sep 23 01:22:15.755686 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:15.776975 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-ebec25bd-6884-4c66-a50a-90ce13909e3a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:15.902500 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-ebec25bd-6884-4c66-a50a-90ce13909e3a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133925 Sep 23 01:22:15.909633 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1336 bytes} [Fri Sep 23 01:22:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:19.923194 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-db974020-8a7e-408d-9e7b-f2dc30271b62 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:19.926119 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-db974020-8a7e-408d-9e7b-f2dc30271b62 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004051 Sep 23 01:22:19.927262 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:19 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:20.818886 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "id": "d4"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:20.927016 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.984317 Sep 23 01:22:20.927913 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:20.949937 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-cf7b9991-3b56-4fe4-8612-c1f2d147a6b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:21.056563 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-cf7b9991-3b56-4fe4-8612-c1f2d147a6b4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.111622 Sep 23 01:22:21.057652 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1336 bytes} [Fri Sep 23 01:22:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:25.010631 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:25.011834 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Sep 23 01:22:25.013156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:25.570958 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-87e2ba97-62da-44a4-9a1a-a571622b3687 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:25.598321 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-87e2ba97-62da-44a4-9a1a-a571622b3687 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.575068 Sep 23 01:22:25.598886 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1292 bytes} [Fri Sep 23 01:22:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:22:28.593832 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:28.595659 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-3b67661b-1f25-40c1-84d2-57fde884bc0c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002540 Sep 23 01:22:28.596404 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:28 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:29.194186 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-eef65ad6-fe75-46ad-95f3-7c11175ba1a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:29.273596 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-eef65ad6-fe75-46ad-95f3-7c11175ba1a4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.666198 Sep 23 01:22:29.274372 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:28 2022] POST /compute/v2.1/flavors => generated 402 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:29.296105 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-4a119d75-b2d1-48df-b1f6-f64d86c6472b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:29.298315 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:29.447613 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-4a119d75-b2d1-48df-b1f6-f64d86c6472b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159638 Sep 23 01:22:29.448212 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1333 bytes} [Fri Sep 23 01:22:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:22:32.269269 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-eef65ad6-fe75-46ad-95f3-7c11175ba1a4 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:32.270201 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-eef65ad6-fe75-46ad-95f3-7c11175ba1a4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 23 01:22:32.270619 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:32.899452 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-c4d1f741-731b-4ae7-9abc-4f42b684ef2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "disk": 20, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:32.987148 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-c4d1f741-731b-4ae7-9abc-4f42b684ef2a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.709309 Sep 23 01:22:32.987770 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:22:33.000321 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-2a6433e9-0e2f-4d58-91a3-430fc94f5149 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:33.006239 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=30,nova_api:SAVEPOINT=3,nova_api:INSERT=6,nova_api:RELEASE=3 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:22:33.109097 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-2a6433e9-0e2f-4d58-91a3-430fc94f5149 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112660 Sep 23 01:22:33.109874 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1333 bytes} [Fri Sep 23 01:22:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:22:35.984985 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-c4d1f741-731b-4ae7-9abc-4f42b684ef2a admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:35.986673 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-c4d1f741-731b-4ae7-9abc-4f42b684ef2a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Sep 23 01:22:35.987134 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:36.679645 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-850c3a3b-3b05-4357-b5a2-ad922cdb3223 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:36.846661 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-850c3a3b-3b05-4357-b5a2-ad922cdb3223 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.852044 Sep 23 01:22:36.847652 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:35 2022] POST /compute/v2.1/flavors => generated 406 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:36.868414 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-12df85f2-6b8d-4ac6-8c4e-57dd2e007421 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:37.009548 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-12df85f2-6b8d-4ac6-8c4e-57dd2e007421 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146774 Sep 23 01:22:37.010433 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1333 bytes} [Fri Sep 23 01:22:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:22:39.811779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-850c3a3b-3b05-4357-b5a2-ad922cdb3223 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:39.812809 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-850c3a3b-3b05-4357-b5a2-ad922cdb3223 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 23 01:22:39.813484 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:40.384452 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-1c180def-4e96-4a4c-8288-57c600e40d9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:40.464298 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-1c180def-4e96-4a4c-8288-57c600e40d9a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.644294 Sep 23 01:22:40.472254 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:40.477871 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-591425a2-1abc-4fca-8748-5aa525d95fc5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:40.578290 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-591425a2-1abc-4fca-8748-5aa525d95fc5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104363 Sep 23 01:22:40.578996 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1333 bytes} [Fri Sep 23 01:22:40 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:22:43.380670 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-1c180def-4e96-4a4c-8288-57c600e40d9a admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:22:43.381725 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-1c180def-4e96-4a4c-8288-57c600e40d9a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Sep 23 01:22:43.382354 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:22:43.922392 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:44.011868 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.618525 Sep 23 01:22:44.020256 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1283 bytes} [Fri Sep 23 01:22:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:22:44.028521 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-ba80738b-539e-4271-94c5-34c87b8aec7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:22:44.149839 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-ba80738b-539e-4271-94c5-34c87b8aec7d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126970 Sep 23 01:22:44.154779 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1333 bytes} [Fri Sep 23 01:22:44 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:23:00.033856 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:00.034853 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Sep 23 01:23:00.035258 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:23:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:00.047022 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:00.476769 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-1f306625-6510-4f1b-8f04-dd8d9fa514a6 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:00.498315 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-1f306625-6510-4f1b-8f04-dd8d9fa514a6 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456291 Sep 23 01:23:00.498881 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1292 bytes} [Fri Sep 23 01:23:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:01.914013 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:01.915064 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-ef45cdc9-25f1-4dc4-a03c-df1fbb2b5091 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 23 01:23:01.915480 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:23:02.518242 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-4a48397b-abd4-4915-b0a5-2ed3df7b5fe5 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:02.524202 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.wsgi [None req-4a48397b-abd4-4915-b0a5-2ed3df7b5fe5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-4a48397b-abd4-4915-b0a5-2ed3df7b5fe5 admin admin] Request method failure captured: Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept: application/json Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept-Encoding: gzip, deflate Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Connection: keep-alive Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Content-Length: 0 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Host: 10.222.0.64 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-System-Scope: None Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: User-Agent: python-novaclient Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Auth-Token: gAAAAABjLQp1C8ZqyNeOkvfveMFxzUk0kAKSPQa3B601YinKdjKcchn3TtwVQXvq6rnEu90OwPBTzbVbaxcALhRp1VIr2Q6ruchYwFf0L_xCsISu3ze10o70AZhqnxrqhzjyQ6sQWmbvG3W5Mqwuj4rnuZqw4ajs40PtMiKN0tZVvR1_-hhYrgI Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Id: None Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Name: None Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Identity-Status: Confirmed Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Is-Admin-Project: True Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Id: default Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Name: Default Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Name: admin Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Role: member,reader,admin Sep 23 01:23:02.528156 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Roles: member,reader,admin Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant: admin Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Name: admin Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User: admin Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Id: default Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Name: Default Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Name: admin Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: method: > Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: exception: Flavor 42 could not be found. Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: action_args: {'id': '42'} Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:02.529776 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:02.530810 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.532064 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-4a48397b-abd4-4915-b0a5-2ed3df7b5fe5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:02.533133 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-4a48397b-abd4-4915-b0a5-2ed3df7b5fe5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.476145 Sep 23 01:23:02.533133 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Sep 23 01:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 477 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 23 01:23:02.542866 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-a8cd7275-abef-41d3-84b9-24352f3c8112 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:02.547177 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:23:02.566519 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-a8cd7275-abef-41d3-84b9-24352f3c8112 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027293 Sep 23 01:23:02.567085 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:02.578958 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-92e6b5a5-05ca-4729-9589-ae5834765046 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:02.602319 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-92e6b5a5-05ca-4729-9589-ae5834765046 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.028364 Sep 23 01:23:02.602805 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:23:02.612592 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-3d28ab35-49c4-4887-bce7-50884fc7e45e admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:02.618344 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.wsgi [None req-3d28ab35-49c4-4887-bce7-50884fc7e45e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-3d28ab35-49c4-4887-bce7-50884fc7e45e admin admin] Request method failure captured: Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept: application/json Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept-Encoding: gzip, deflate Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Connection: keep-alive Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Content-Length: 0 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Host: 10.222.0.64 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-System-Scope: None Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: User-Agent: python-novaclient Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Auth-Token: gAAAAABjLQp1C8ZqyNeOkvfveMFxzUk0kAKSPQa3B601YinKdjKcchn3TtwVQXvq6rnEu90OwPBTzbVbaxcALhRp1VIr2Q6ruchYwFf0L_xCsISu3ze10o70AZhqnxrqhzjyQ6sQWmbvG3W5Mqwuj4rnuZqw4ajs40PtMiKN0tZVvR1_-hhYrgI Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Id: None Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Name: None Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Identity-Status: Confirmed Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Is-Admin-Project: True Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Id: default Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Name: Default Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Name: admin Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Role: member,reader,admin Sep 23 01:23:02.621733 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Roles: member,reader,admin Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant: admin Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Name: admin Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User: admin Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Id: default Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Name: Default Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Name: admin Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: method: > Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: exception: Flavor 42 could not be found. Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: action_args: {'id': '42'} Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:02.623034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:02.623900 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:02.625020 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-3d28ab35-49c4-4887-bce7-50884fc7e45e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:02.626159 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-3d28ab35-49c4-4887-bce7-50884fc7e45e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014337 Sep 23 01:23:02.626159 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Sep 23 01:23:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:03.911836 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-92e6b5a5-05ca-4729-9589-ae5834765046 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:03.912884 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-92e6b5a5-05ca-4729-9589-ae5834765046 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Sep 23 01:23:03.913290 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:04.479631 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-200f6c77-8e44-4edb-a33b-93b892d4283d admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:04.485503 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.wsgi [None req-200f6c77-8e44-4edb-a33b-93b892d4283d admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-200f6c77-8e44-4edb-a33b-93b892d4283d admin admin] Request method failure captured: Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept: application/json Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept-Encoding: gzip, deflate Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Connection: keep-alive Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Content-Length: 0 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Host: 10.222.0.64 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-System-Scope: None Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: User-Agent: python-novaclient Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Auth-Token: gAAAAABjLQp3wqdrj40AZsqmYiaIo4mrWmsqCOYDJoS-GGfV_0BamA3EnS_hFNgQhgkHCRXmJhBH4Yyr4vQS0j9K0ks0gbzkbTjSULU5Jg9KF1UQSscWvYR245bY819-yphzOz48336yEm67e16I5vN31BFl-J6U4fmEQ-bfVeKwmrZpwJwR5b4 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Id: None Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Name: None Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Identity-Status: Confirmed Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Is-Admin-Project: True Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Id: default Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Name: Default Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Name: admin Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Role: member,reader,admin Sep 23 01:23:04.487081 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Roles: member,reader,admin Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant: admin Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Name: admin Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User: admin Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Id: default Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Name: Default Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Name: admin Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: method: > Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: exception: Flavor 84 could not be found. Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: action_args: {'id': '84'} Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:04.488784 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:04.489721 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.491363 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-200f6c77-8e44-4edb-a33b-93b892d4283d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:04.492746 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-200f6c77-8e44-4edb-a33b-93b892d4283d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.433242 Sep 23 01:23:04.492746 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Sep 23 01:23:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:04.499946 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-f94e8737-9aeb-4cc0-b9ae-cdc0541d24fd admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:04.515941 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-f94e8737-9aeb-4cc0-b9ae-cdc0541d24fd admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019555 Sep 23 01:23:04.516521 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:04.527044 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-88529d9c-ecc5-4175-a92e-4b874d94dd69 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:04.543451 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-88529d9c-ecc5-4175-a92e-4b874d94dd69 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020456 Sep 23 01:23:04.544034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:04.553680 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-10939038-0821-4282-97a9-af9de51b67b5 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:04.558832 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.wsgi [None req-10939038-0821-4282-97a9-af9de51b67b5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-10939038-0821-4282-97a9-af9de51b67b5 admin admin] Request method failure captured: Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept: application/json Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept-Encoding: gzip, deflate Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Connection: keep-alive Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Content-Length: 0 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Host: 10.222.0.64 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-System-Scope: None Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: User-Agent: python-novaclient Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Auth-Token: gAAAAABjLQp3wqdrj40AZsqmYiaIo4mrWmsqCOYDJoS-GGfV_0BamA3EnS_hFNgQhgkHCRXmJhBH4Yyr4vQS0j9K0ks0gbzkbTjSULU5Jg9KF1UQSscWvYR245bY819-yphzOz48336yEm67e16I5vN31BFl-J6U4fmEQ-bfVeKwmrZpwJwR5b4 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Id: None Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Name: None Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Identity-Status: Confirmed Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Is-Admin-Project: True Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Id: default Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Name: Default Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Name: admin Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Role: member,reader,admin Sep 23 01:23:04.560387 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Roles: member,reader,admin Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant: admin Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Name: admin Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User: admin Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Id: default Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Name: Default Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Name: admin Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: method: > Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: exception: Flavor 84 could not be found. Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: action_args: {'id': '84'} Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:04.561901 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:04.562738 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:04.563878 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-10939038-0821-4282-97a9-af9de51b67b5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:04.564888 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-10939038-0821-4282-97a9-af9de51b67b5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011662 Sep 23 01:23:04.564888 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Sep 23 01:23:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:05.866526 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-88529d9c-ecc5-4175-a92e-4b874d94dd69 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:05.868375 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-88529d9c-ecc5-4175-a92e-4b874d94dd69 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002539 Sep 23 01:23:05.869116 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:06.574400 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-38f66b2f-6103-4286-9ce1-79cec2efb09e admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:06.582079 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.wsgi [None req-38f66b2f-6103-4286-9ce1-79cec2efb09e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-38f66b2f-6103-4286-9ce1-79cec2efb09e admin admin] Request method failure captured: Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept: application/json Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Accept-Encoding: gzip, deflate Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Connection: keep-alive Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Content-Length: 0 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Host: 10.222.0.64 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Openstack-System-Scope: None Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: User-Agent: python-novaclient Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Auth-Token: gAAAAABjLQp5nlIHsggHcRPol2mxXvgJrjOybtPAEpEZhoG3jRWCLUK7j2yVvH_8Qg1drvVdOtv-VYRlCys7GXObv-dqskKS4Q9KyJAgCWPPws5Gh3XMcVo1w1FbfsCzvuPTXuVk_TmkShUuZm3hCZ3Wyq-sq9aLZwmF2QvxtwdPkuTzuXmGxMM Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Id: None Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Domain-Name: None Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Identity-Status: Confirmed Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Is-Admin-Project: True Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Id: default Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Domain-Name: Default Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Project-Name: admin Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Role: member,reader,admin Sep 23 01:23:06.583963 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Roles: member,reader,admin Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant: admin Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-Tenant-Name: admin Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User: admin Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Id: default Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Domain-Name: Default Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: X-User-Name: admin Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: method: > Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: exception: Flavor 451 could not be found. Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: action_args: {'id': '451'} Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:06.585751 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:06.586749 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.588102 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-38f66b2f-6103-4286-9ce1-79cec2efb09e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106447) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:06.589714 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-38f66b2f-6103-4286-9ce1-79cec2efb09e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.448600 Sep 23 01:23:06.589714 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:23:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 450 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:06.595997 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-4b69d6c5-07eb-49d3-9472-7b555e10a7e9 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:06.611991 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-4b69d6c5-07eb-49d3-9472-7b555e10a7e9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019660 Sep 23 01:23:06.612560 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:06.622659 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:06.637943 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018844 Sep 23 01:23:06.638514 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Sep 23 01:23:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:23:06.648071 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-6ed4b21b-0799-4658-84bb-98c0bcd05bbf admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:06.653764 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.wsgi [None req-6ed4b21b-0799-4658-84bb-98c0bcd05bbf admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-6ed4b21b-0799-4658-84bb-98c0bcd05bbf admin admin] Request method failure captured: Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept: application/json Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Accept-Encoding: gzip, deflate Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Connection: keep-alive Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Content-Length: 0 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Host: 10.222.0.64 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-Api-Version: compute 2.92 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Openstack-System-Scope: None Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: User-Agent: python-novaclient Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Auth-Token: gAAAAABjLQp5nlIHsggHcRPol2mxXvgJrjOybtPAEpEZhoG3jRWCLUK7j2yVvH_8Qg1drvVdOtv-VYRlCys7GXObv-dqskKS4Q9KyJAgCWPPws5Gh3XMcVo1w1FbfsCzvuPTXuVk_TmkShUuZm3hCZ3Wyq-sq9aLZwmF2QvxtwdPkuTzuXmGxMM Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Id: None Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Domain-Name: None Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Identity-Status: Confirmed Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Is-Admin-Project: True Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Openstack-Nova-Api-Version: 2.92 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Id: default Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Domain-Name: Default Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Project-Name: admin Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Role: member,reader,admin Sep 23 01:23:06.655345 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Roles: member,reader,admin Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/9c4e8ab21bdd4e5ebc7ac91f1638bec3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_9c4e8ab21bdd4e5ebc7ac91f1638bec3", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant: admin Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Id: 9c4e8ab21bdd4e5ebc7ac91f1638bec3 Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-Tenant-Name: admin Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User: admin Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Id: default Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Domain-Name: Default Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Id: efae8da899ef465d9872282b2bb91fef Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: X-User-Name: admin Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: method: > Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: exception: Flavor 451 could not be found. Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: action_args: {'id': '451'} Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:23:06.656834 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:06.657665 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: ERROR nova.api.openstack.wsgi Sep 23 01:23:06.658718 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-6ed4b21b-0799-4658-84bb-98c0bcd05bbf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106446) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:23:06.659779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-6ed4b21b-0799-4658-84bb-98c0bcd05bbf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012352 Sep 23 01:23:06.659779 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:23:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 23 01:23:07.963363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:07.963363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Sep 23 01:23:07.963363 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:08.512167 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-5ce0045a-91c5-44c2-a750-5709e3ff8fa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:23:08.624056 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-5ce0045a-91c5-44c2-a750-5709e3ff8fa0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.537256 Sep 23 01:23:08.624686 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Sep 23 01:23:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:23:10.000702 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:10.001657 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 23 01:23:10.002080 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:10.592097 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-9f0e6204-81fd-4206-bb82-d5b7681b4f8e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:23:10.682102 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-9f0e6204-81fd-4206-bb82-d5b7681b4f8e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.540467 Sep 23 01:23:10.682741 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Sep 23 01:23:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:23:11.961229 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:11.962334 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 23 01:23:11.962648 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:12.522589 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-426cfa81-171d-4cd1-b68d-97c5e8f6e62d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:23:12.620262 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-426cfa81-171d-4cd1-b68d-97c5e8f6e62d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.520741 Sep 23 01:23:12.620987 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Sep 23 01:23:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:23:13.922967 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:13.924218 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Sep 23 01:23:13.924646 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:14.553826 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-7d38fb08-ea04-4dd8-870d-ecafac02617c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:23:14.699778 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-7d38fb08-ea04-4dd8-870d-ecafac02617c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.629765 Sep 23 01:23:14.700199 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Sep 23 01:23:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:23:16.004899 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:16.005940 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 23 01:23:16.006345 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:23:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:23:16.577297 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-69b499b0-e99a-4952-b2f3-4be8bb891d33 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:23:16.599139 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-69b499b0-e99a-4952-b2f3-4be8bb891d33 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.448557 Sep 23 01:23:16.599747 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Fri Sep 23 01:23:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:24:16.148473 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.149526 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-9087c734-ce68-4d7a-a967-4c15e1400cc2 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Sep 23 01:24:16.149922 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 931 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:24:16.161640 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:16.598379 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-cbf10ff8-857d-4822-b9d5-04aa76006856 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.621358 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-cbf10ff8-857d-4822-b9d5-04aa76006856 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.464793 Sep 23 01:24:16.621921 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1292 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:24:16.643017 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_api:SELECT=14 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:24:16.646874 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-84cac347-b3e9-4322-96ee-7deaa59d9623 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.654991 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-84cac347-b3e9-4322-96ee-7deaa59d9623 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013357 Sep 23 01:24:16.658929 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1283 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:24:16.669005 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-2425af91-7530-4123-b212-fdcb719f934b admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.677362 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-2425af91-7530-4123-b212-fdcb719f934b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012585 Sep 23 01:24:16.677921 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1286 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:24:16.690406 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.698334 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012027 Sep 23 01:24:16.698930 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1286 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:24:16.711330 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-4093f6c5-f964-4572-8b7e-26c1693f513d admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:24:16.719372 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-4093f6c5-f964-4572-8b7e-26c1693f513d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011699 Sep 23 01:24:16.719969 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1283 bytes} [Fri Sep 23 01:24:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:27:42.427074 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:42.428139 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Sep 23 01:27:42.428547 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:27:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:27:42.570036 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=6 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:27:42.714753 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:42.719525 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:42.720034 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:42.720467 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:42.721182 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:42.721629 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:42.722044 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:42.754249 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-44007951-4eac-4286-90f4-e791e86df6b4 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.185194 Sep 23 01:27:42.754823 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:27:42 2022] GET /compute/v2.1/os-services => generated 791 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:27:43.851583 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:43.852607 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Sep 23 01:27:43.853047 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:27:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:27:44.044933 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:44.048516 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:44.048998 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:44.049421 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:44.050135 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:44.050581 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:44.050997 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:44.070143 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-f15c255c-4811-4e92-8751-9c23dececdd9 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078476 Sep 23 01:27:44.070628 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:27:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:27:55.597188 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:55.598223 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 23 01:27:55.598616 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:27:55.744318 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_cell0:SELECT=4 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:27:55.745046 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_cell1:SELECT=4 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:27:55.745693 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG dbcounter [-] [106446] Writing DB stats nova_api:SELECT=8 {{(pid=106446) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:27:55.795438 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:55.798922 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:55.799425 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:55.799882 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:55.800597 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:55.801040 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:55.801457 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:55.828092 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-89c07174-c077-415d-8a00-03b21a39a24f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.088209 Sep 23 01:27:55.828588 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:27:55 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:27:56.922734 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG nova.api.openstack.wsgi [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] Calling method '>' {{(pid=106447) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:56.923798 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: INFO nova.api.openstack.requestlog [None req-e5e4b093-013e-4d62-a57c-b867cf882b58 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 23 01:27:56.924274 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: [pid: 106447|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Sep 23 01:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:27:57.124605 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG nova.api.openstack.wsgi [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Calling method '>' {{(pid=106446) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:27:57.128134 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:57.128612 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:57.129044 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:57.129761 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:27:57.130213 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:27:57.130629 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: DEBUG oslo_concurrency.lockutils [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106446) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:27:57.153097 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: INFO nova.api.openstack.requestlog [None req-c4e570d6-6f8e-4495-a073-aa1bca71025f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.084866 Sep 23 01:27:57.153682 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: [pid: 106446|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Sep 23 01:27:57 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:28:53.493519 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: Fri Sep 23 01:28:53 2022 - graceful shutdown triggered... Sep 23 01:28:53.494081 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: Gracefully killing worker 2 (pid: 106447)... Sep 23 01:28:53.494447 dv-cinder-849143-7-iscsi devstack@n-api.service[106446]: Gracefully killing worker 1 (pid: 106446)... Sep 23 01:28:53.495789 dv-cinder-849143-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 23 01:28:53.619972 dv-cinder-849143-7-iscsi devstack@n-api.service[106447]: DEBUG dbcounter [-] [106447] Writing DB stats nova_api:SELECT=4 {{(pid=106447) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:28:54.494656 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: worker 1 buried after 1 seconds Sep 23 01:28:54.494656 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: worker 2 buried after 1 seconds Sep 23 01:28:54.494656 dv-cinder-849143-7-iscsi devstack@n-api.service[106445]: goodbye to uWSGI. Sep 23 01:28:54.496356 dv-cinder-849143-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 23 01:28:54.496924 dv-cinder-849143-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 23 01:28:54.499702 dv-cinder-849143-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 23 01:28:54.511215 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 23 01:28:54 2022] *** Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: nodename: dv-cinder-849143-7-iscsi Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: machine: x86_64 Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: clock source: unix Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: pcre jit disabled Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: detected number of CPU cores: 4 Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: current working directory: / Sep 23 01:28:54.513286 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: detected binary path: /usr/bin/uwsgi-core Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: your processes number limit is 47680 Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: your memory page size is 4096 bytes Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: detected max file descriptor number: 2048 Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: lock engine: pthread robust mutexes Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: thunder lock: enabled Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 23 01:28:54.514035 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 23 01:28:54.555206 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: Python main interpreter initialized at 0x558668c169c0 Sep 23 01:28:54.555206 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: python threads support enabled Sep 23 01:28:54.555206 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: your server socket listen backlog is limited to 100 connections Sep 23 01:28:54.555206 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: your mercy for graceful operations on workers is 90 seconds Sep 23 01:28:54.555718 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: mapped 403077 bytes (393 KB) for 2 cores Sep 23 01:28:54.555718 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: *** Operational MODE: preforking *** Sep 23 01:28:54.556044 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: *** uWSGI is running in multiple interpreter mode *** Sep 23 01:28:54.556044 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: spawned uWSGI master process (pid: 121751) Sep 23 01:28:54.556250 dv-cinder-849143-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 23 01:28:54.557422 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: spawned uWSGI worker 1 (pid: 121762, cores: 1) Sep 23 01:28:54.557422 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: spawned uWSGI worker 2 (pid: 121763, cores: 1) Sep 23 01:28:54.557422 dv-cinder-849143-7-iscsi devstack@n-api.service[121751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 23 01:28:55.250580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 01:28:55.253262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 23 01:28:56.426596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:28:56.426596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: from cryptography.utils import int_from_bytes Sep 23 01:28:56.427638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:28:56.427638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: from cryptography.utils import int_from_bytes Sep 23 01:28:56.427777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:28:56.427777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: from cryptography.utils import int_from_bytes Sep 23 01:28:56.427777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 23 01:28:56.427777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: from cryptography.utils import int_from_bytes Sep 23 01:28:58.894353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:28:58.894963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:28:58.895199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:28:58.895565 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:28:58.895829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:28:58.896226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.896549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.896869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.897188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.897519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.897828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.898147 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.898463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.898789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.899047 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.899357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.899867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-7-iscsi {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.900197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.900507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.900822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.901141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.901481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.901806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.902128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.902639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904751 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.904968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.905281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.905609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.905916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.906895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-7-iscsi {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.907217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.907534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.907875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.908292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.908622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.908928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.909236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.909426 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 23 01:28:58.909888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.909983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 23 01:28:58.910058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.910267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.910389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 23 01:28:58.910478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.910678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 23 01:28:58.910813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.910894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 23 01:28:58.911102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.911217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.911476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.911756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.912014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.912225 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.912439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.912637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.912878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913041 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913234 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.913836 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914268 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914578 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.914895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-7-iscsi {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.915964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916443 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.916973 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.917950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.918878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.919919 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.920075 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.920224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.921315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.921539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.921702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.921887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922349 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.922994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-7-iscsi {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923143 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.923914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924670 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.924978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.925903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.926849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927156 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927641 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.927960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928415 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928578 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.928872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929345 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.929963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.930109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.930263 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.930504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.931455 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.931683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.931853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.932928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.933871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934635 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.934937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935095 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935574 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.935897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.936966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.937868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938023 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.938934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.939092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.939268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.939424 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.939697 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.939864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.940793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.941853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942641 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.942954 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.943942 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.944089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.944235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.944402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.944558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.944792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.944989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.945143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.945290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.945444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.945608 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.945758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.945758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.946035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.946188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.946357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.946520 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.946674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.946821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.946966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.947112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.947264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.947426 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.947626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.947793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.947948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.948095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.948250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.948419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.948576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.948732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.948924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.949076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.949248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.949409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.949557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.949718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.949866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.950011 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.950157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.950311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.950476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.950639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.950795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.950950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.951297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.955100 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.955279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.955461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.955636 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.955838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.956025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.956176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.956356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.956524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.956680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.956835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.956984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.957138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.957300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.957456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.957611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.957765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.957920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.958069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.958228 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.958388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.958542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.958689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.958844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.958992 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.959160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.959321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.959468 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.959649 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.959810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.959969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.960128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.960286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.960452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.960601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.960748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.960894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.961040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.961449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.962360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.962544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.962852 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.963269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.963269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.963589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.963756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.963926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 23 01:28:58.964232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.964982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.965897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.966950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967254 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967408 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967582 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.967949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.968110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.968258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.968404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.968560 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.968757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.969426 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.969584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.969742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.969898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.970984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.971139 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.971297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.971678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.972142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.972718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.972878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.973952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.974249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.974403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.974559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.974717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.974873 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.975034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.975202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.975479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.975693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.975847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976593 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.976901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977204 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977352 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.977889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978204 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978670 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978826 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.978975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.979935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980093 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.980978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.981127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.981290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.981445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.981785 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.981966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.982351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.982517 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.982959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.983991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984138 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984805 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.984962 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.985123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.985325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.985625 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.985788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.985957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.986934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.987858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988167 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988323 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988480 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988785 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.988942 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.989905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.990934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.991083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.991237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.991384 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.991542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.991901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.992073 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.992432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.992596 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.992774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.993221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.993392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.993569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.993720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.993875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994023 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994475 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.994928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.995961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.996731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997033 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997661 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.997980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998721 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.998880 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:58.999842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000029 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.000905 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001063 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.001857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.002193 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.002525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.002691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.002848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.003025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.003532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.003769 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.003920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.004995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.005143 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.005300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.005455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.005603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.005775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006492 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.006944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.007100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.007257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.007829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.007990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008296 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.008912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.009257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.009419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.009581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.009737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.009892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.010046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.010207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.010458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.010614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.010867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011362 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.011896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.012235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.012399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.012731 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.012942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.013104 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.013625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.013800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.013956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.014921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.015082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.015235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.015388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.016213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.016389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.016546 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.016713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.016861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.017019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.017773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.017940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018372 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.018964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.019498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.019722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.019722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.020784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.021870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.022018 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.022203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.022589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.022972 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.023138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.023287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.023461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024215 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.024886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025630 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.025942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.026091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.026355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.026518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.026687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.026845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.027945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028396 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.028861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029164 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029321 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.029942 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.030981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.031861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.032041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.032208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.032363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.032739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.033126 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.033542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.033702 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.033909 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.034250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.034410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.034586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.034741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.034908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.035907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.036062 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.036214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.036391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.036655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.036815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.037060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.037242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.037405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.037723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.037887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.038834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039053 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039219 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.039921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.040911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041073 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.041995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.042149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.042303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.042456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.042637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.042945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.043275 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.043438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.043729 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.043916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.044084 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.044319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.044577 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.044745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.044898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.045874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.046122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.046279 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.046441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.046604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.046884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047627 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.047987 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.048791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.049376 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.049542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.049716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.049891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050537 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.050860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.051870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.052788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.053932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.054351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.054351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.054760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.054922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055797 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.055961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.056123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.056287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.056442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.056607 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.056761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057501 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.057815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058131 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.058914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.059911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060719 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.060881 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061553 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.061891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.062046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.062200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.062404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.062720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.062908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.063257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.063613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.063779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.063935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.064100 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.064270 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.064485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.064655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.064945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.065931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.066908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.067174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.067342 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.067507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.067687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.067853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.068977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.069133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.069295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.069479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.070693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.070865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.071948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.072103 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.072258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.072444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.072444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.072857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.073046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.073237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.073735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.073908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.073908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074203 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.074931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.075328 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.075595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.075774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.075774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.076867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.077950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.078697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.078858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079503 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079728 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.079886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.080858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.081853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.082972 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.083134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.083297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.083666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.083917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084790 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.084953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.085117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.085380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.085550 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.085706 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.085862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086508 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086671 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.086989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.087143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.087325 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.087597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.087775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.088188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.088349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.088504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.088749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.088907 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089556 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089723 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.089878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.090741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.091876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.092036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.092189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.092353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.092515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.092689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.093012 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.093185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.093352 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.093542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.094496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.094611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.094718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.094810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.094906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095852 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.095940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096234 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096418 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096690 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.096966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097053 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.097974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098417 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098503 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098698 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.098996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.099968 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100063 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100352 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100821 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.100920 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101204 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101292 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101702 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.101988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.102916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103374 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103635 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.103984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104492 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.104749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105314 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.105928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106011 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106011 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106731 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.106920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107030 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107228 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107422 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107517 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107649 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.107901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108546 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.108929 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.109975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.110931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.111997 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112362 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112630 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112813 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.112997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113385 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.113991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.114911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.115993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116560 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116634 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.116859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117170 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117251 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117665 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.117959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.118958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119694 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119777 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.119939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120012 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120398 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.120865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121892 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.121974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122671 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.122965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123505 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123635 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.123882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124551 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.124939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.125998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.126994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127578 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.127997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128770 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.128993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129448 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129769 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.129977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130084 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130825 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.130933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.131926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132663 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.132984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.133200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.133304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.133520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.133780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.133883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134782 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.134878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135104 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135239 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135418 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.135851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.136994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.137908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138516 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.138922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139751 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.139848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.140079 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.140226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.140363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.140461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141563 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141669 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.141996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.142915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.143915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.144803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.145967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.146486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.146808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.147127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.147435 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.147790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.147959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.148985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.149082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.149300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.149605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.149932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.150973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151671 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.151921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.152133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.152453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.152547 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.152965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.153276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.153583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.153916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.154212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.154528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.155989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.156227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.156862 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.156953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.157920 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.158141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.158253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.158488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.158592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.158800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.159381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.160177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.160506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.160827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.161515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.161722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.161833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:28:59.162106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.162432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.162755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.163075 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.163394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.163744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.164089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.164376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.164690 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.165008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.165321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.165640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.165958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.166268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.166585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.166895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.167205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.167519 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.167995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.168223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.168546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.168877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.169197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.169526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.169841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.170171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.170502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.170831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.171146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.171484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.171857 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.172178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.172498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.172813 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.173127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.173439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.173773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.174102 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.174414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.174746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.175077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.175404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.175824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.176149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.176484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.176803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.177122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.177437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.177756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.178071 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.178392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.178706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.179024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.179343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.179684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.180017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.180347 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.180662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.180991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.181323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.181677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.181994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.182344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.182675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.182990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.183306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.183635 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 23 01:28:59.183922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 23 01:28:59.225684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO dbcounter [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Registered counter for database nova_api Sep 23 01:28:59.247020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.247250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO dbcounter [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Registered counter for database nova_api Sep 23 01:28:59.254762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writer thread running {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.268083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_db.sqlalchemy.engines [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.274662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writer thread running {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.311632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.context [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),365480e9-a6c8-4545-aa74-07b831267c7c(cell1) {{(pid=121762) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 01:28:59.315741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:28:59.316212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:28:59.317761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:28:59.318494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:28:59.318932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:28:59.320936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:28:59.322934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO dbcounter [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Registered counter for database nova_cell0 Sep 23 01:28:59.327215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO dbcounter [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Registered counter for database nova_cell1 Sep 23 01:28:59.333936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.context [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),365480e9-a6c8-4545-aa74-07b831267c7c(cell1) {{(pid=121763) load_cells /opt/stack/nova/nova/context.py:464}} Sep 23 01:28:59.334772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.336197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:28:59.336657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:28:59.336916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.338544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:28:59.339299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:28:59.339788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:28:59.341791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:28:59.343413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writer thread running {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.344404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO dbcounter [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Registered counter for database nova_cell0 Sep 23 01:28:59.345284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writer thread running {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.348544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO dbcounter [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Registered counter for database nova_cell1 Sep 23 01:28:59.356474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_db.sqlalchemy.engines [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.357882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_db.sqlalchemy.engines [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.365086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writer thread running {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.367207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writer thread running {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.496509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO dbcounter [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Registered counter for database nova_cell0 Sep 23 01:28:59.503757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.508668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writer thread running {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.528590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO dbcounter [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Registered counter for database nova_cell0 Sep 23 01:28:59.536820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_db.sqlalchemy.engines [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 23 01:28:59.541750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writer thread running {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 23 01:28:59.836511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: WARNING keystonemiddleware.auth_token [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:28:59.844296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: WARNING keystonemiddleware.auth_token [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:28:59.871332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: WARNING keystonemiddleware.auth_token [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:28:59.880059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: WARNING keystonemiddleware.auth_token [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:29:00.197966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: WARNING keystonemiddleware.auth_token [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:29:00.204133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: WARNING keystonemiddleware.auth_token [None req-6dd62e76-170e-4d93-8a76-5f58a7aba21a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:29:00.210341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558668c169c0 pid: 121762 (default app) Sep 23 01:29:00.231087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: WARNING keystonemiddleware.auth_token [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 23 01:29:00.237851 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: WARNING keystonemiddleware.auth_token [None req-19edd03a-d77d-4906-8ab6-168e346bf3d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 23 01:29:00.243358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558668c169c0 pid: 121763 (default app) Sep 23 01:29:39.522797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:39.522797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:39.522797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:39.522797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:40.517205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-63a9cdfd-99af-4bc7-a771-69c3e1a596f9 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Action: 'create', calling method: .version_select at 0x7f767a095430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-581095278"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:29:42.497247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-63a9cdfd-99af-4bc7-a771-69c3e1a596f9 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.055403 Sep 23 01:29:42.498310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Fri Sep 23 01:29:39 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3058 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 01:29:42.515889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-663703ef-e301-4aa6-8b52-2e76f88865f7 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f69310>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:42.629760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-663703ef-e301-4aa6-8b52-2e76f88865f7 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 200 len: 344 microversion: 2.1 time: 0.108102 Sep 23 01:29:42.629760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 2/2] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:42 2022] GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 344 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:42.833019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-497ff128-9aa0-4a1b-a499-7cb61f5da0d2 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f767a144f70>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:42.863814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:42.864787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:42.865761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:42.876956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:29:43.357682 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-497ff128-9aa0-4a1b-a499-7cb61f5da0d2 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/ccc5897b-3672-4d87-9c61-5fbd576bf7a7" status: 200 len: 350 microversion: 2.1 time: 1.000370 Sep 23 01:29:43.358944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 1/3] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:42 2022] GET /compute/v2.1/os-volumes/ccc5897b-3672-4d87-9c61-5fbd576bf7a7 => generated 350 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:43.643339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-84abd8f3-716b-4f1c-be2b-23ac4d9d1998 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f699d0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:43.772959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-84abd8f3-716b-4f1c-be2b-23ac4d9d1998 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 200 len: 345 microversion: 2.1 time: 0.126104 Sep 23 01:29:43.772959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 3/4] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:43 2022] GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:43.780171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-281ca6d2-b42d-42d4-86bc-5d1ffbdd3201 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Action: 'create', calling method: .version_select at 0x7f7679f56550>, body: {"snapshot": {"volume_id": "a40ec9f8-4fb3-49d1-a102-1086d73a40ec", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-538914910"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:29:45.160744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-281ca6d2-b42d-42d4-86bc-5d1ffbdd3201 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.384747 Sep 23 01:29:45.173898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a938a728-d907-460f-9247-304d48e13b51 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f780d0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:45.175371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 2/5] 10.222.0.64 () {60 vars in 1162 bytes} [Fri Sep 23 01:29:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:45.427439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a938a728-d907-460f-9247-304d48e13b51 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.257957 Sep 23 01:29:45.428282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 4/6] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:45 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:45.441953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-890243c9-3f90-4117-a685-9fffaefeabc4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f56160>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:45.503183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-890243c9-3f90-4117-a685-9fffaefeabc4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.066577 Sep 23 01:29:45.503792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 3/7] 10.222.0.64 () {58 vars in 1140 bytes} [Fri Sep 23 01:29:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:45.517539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2a822843-42a4-4c7f-9446-b39a2202a518 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f69ca0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:45.591413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2a822843-42a4-4c7f-9446-b39a2202a518 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.071948 Sep 23 01:29:45.591413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 5/8] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:45 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:45.606985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a2235f72-7bd9-4f90-af02-9c4613121839 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679efa700>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:45.707439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a2235f72-7bd9-4f90-af02-9c4613121839 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/59259f7a-1d1a-4543-8444-d371b87f4d92" status: 200 len: 350 microversion: 2.1 time: 0.105355 Sep 23 01:29:45.722275 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 4/9] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:45 2022] GET /compute/v2.1/os-volumes/59259f7a-1d1a-4543-8444-d371b87f4d92 => generated 350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:46.599363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1b5c8ae6-9736-42ed-a21e-36885acc25e4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f695e0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:46.718698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1b5c8ae6-9736-42ed-a21e-36885acc25e4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.124247 Sep 23 01:29:46.719971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 6/10] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:46 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:47.736593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8ced4f3b-e737-4d85-ab1c-786f53c8d0ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679efae50>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:47.839628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8ced4f3b-e737-4d85-ab1c-786f53c8d0ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.110678 Sep 23 01:29:47.840215 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 5/11] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:47 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:48.854705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b70ed077-9670-4af5-9ed0-0a62fdf33bc3 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f781f0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:48.961013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b70ed077-9670-4af5-9ed0-0a62fdf33bc3 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.110547 Sep 23 01:29:48.962297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 7/12] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:48 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:49.547321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-93b51585-1ea6-4c3b-9d7b-fe6446d535c9 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679efa790>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:49.752358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-93b51585-1ea6-4c3b-9d7b-fe6446d535c9 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f6564bcb-5180-4970-a568-1593ec2baeeb" status: 200 len: 350 microversion: 2.1 time: 0.211685 Sep 23 01:29:49.770613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 6/13] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:49 2022] GET /compute/v2.1/os-volumes/f6564bcb-5180-4970-a568-1593ec2baeeb => generated 350 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:49.772498 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3a00b1e2-4f4e-474e-abbe-3d6f183ae6a8 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f69550>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.000917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a3fd3a59-9461-4309-9f00-e79e780346c4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f767a8c3790>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.010779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3a00b1e2-4f4e-474e-abbe-3d6f183ae6a8 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.245231 Sep 23 01:29:50.033449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 8/14] 10.222.0.64 () {58 vars in 1134 bytes} [Fri Sep 23 01:29:49 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:50.055645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-76930a5b-4719-4494-841c-f7cd650457bf tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f78160>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.092865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a3fd3a59-9461-4309-9f00-e79e780346c4 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 287 microversion: 2.1 time: 0.110736 Sep 23 01:29:50.100884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:49 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 287 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:50.114911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6da28af5-a32f-4968-8182-a1fe65c44a82 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f56820>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.215528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-76930a5b-4719-4494-841c-f7cd650457bf tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.177820 Sep 23 01:29:50.216261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 9/16] 10.222.0.64 () {58 vars in 1149 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:50.235493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b56497db-7931-4061-a375-8e2924132f34 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f78d30>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.317673 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6da28af5-a32f-4968-8182-a1fe65c44a82 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 202 len: 0 microversion: 2.1 time: 0.208806 Sep 23 01:29:50.318373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 8/17] 10.222.0.64 () {58 vars in 1254 bytes} [Fri Sep 23 01:29:50 2022] DELETE /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:29:50.334342 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c9581e29-bde2-4d5b-a058-d0c5c0fb1981 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679efac10>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.432984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c9581e29-bde2-4d5b-a058-d0c5c0fb1981 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 200 len: 286 microversion: 2.1 time: 0.108423 Sep 23 01:29:50.433760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:50.448577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b56497db-7931-4061-a375-8e2924132f34 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.205349 Sep 23 01:29:50.448577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1134 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:50.454212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6a19319c-541f-47bc-a960-7070810add99 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f69a60>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.573660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6a19319c-541f-47bc-a960-7070810add99 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.123609 Sep 23 01:29:50.574750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 11/20] 10.222.0.64 () {58 vars in 1167 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:50.594212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6def0ca0-e85d-4e16-bdc9-e78087c54689 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679efa4c0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.731942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6def0ca0-e85d-4e16-bdc9-e78087c54689 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.144972 Sep 23 01:29:50.733903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 10/21] 10.222.0.64 () {58 vars in 1170 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:50.755865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4149ab7b-fa9e-4aa9-bd41-98d978aba301 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f08940>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:50.898899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4149ab7b-fa9e-4aa9-bd41-98d978aba301 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.155035 Sep 23 01:29:50.908353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 12/22] 10.222.0.64 () {58 vars in 1155 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:50.919922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b3619af8-f921-4178-b500-beb124bc9d58 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f56dc0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:51.128765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b3619af8-f921-4178-b500-beb124bc9d58 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.214712 Sep 23 01:29:51.139240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1188 bytes} [Fri Sep 23 01:29:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:51.146815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e5dd33ce-5a5f-4424-98d7-8113db231150 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] Calling method '.version_select at 0x7f7679f690d0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:51.342176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e5dd33ce-5a5f-4424-98d7-8113db231150 tempest-VolumesTestJSON-791196409 tempest-VolumesTestJSON-791196409-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.201490 Sep 23 01:29:51.342971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 13/24] 10.222.0.64 () {58 vars in 1155 bytes} [Fri Sep 23 01:29:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:51.446822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f49c6a75-36f1-49ca-bb20-b1febbc58d68 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f56670>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:51.509045 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-f49c6a75-36f1-49ca-bb20-b1febbc58d68 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] HTTP exception thrown: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f49c6a75-36f1-49ca-bb20-b1febbc58d68 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Request method failure captured: Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 HTTP/1.1 Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwDUEl6eBV-zMbEiSif1BVPVToP69d9-vE5y2B17x0F5Qr8xM_yJJSGtideTYceyG43TiC4QNiwJWHZulpPKiX1IeVx1N4CbRXcJbWSczkU3ZhXFLud69V1_BeFmhtCJcygZbEJojuGIPaPb0bXvUMUIWfV8ZGzjqlURhi_LGj1LJU Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:29:51.514737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c44d377f4f9749798e0a1c4ee9a6a5ee", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 0cdb50891eb44beba40f2bd9dbeb4759 Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'ae347260-35d9-47e4-bb1c-cc77e571f080'} Sep 23 01:29:51.516171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. (HTTP 404) (Request-ID: req-2e67aad9-1d27-48cb-b39f-87d1c088da80) Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.516995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:51.518049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 23 01:29:51.520070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f49c6a75-36f1-49ca-bb20-b1febbc58d68 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Returning 404 to user: Snapshot ae347260-35d9-47e4-bb1c-cc77e571f080 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:29:51.522286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f49c6a75-36f1-49ca-bb20-b1febbc58d68 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080" status: 404 len: 111 microversion: 2.1 time: 0.073613 Sep 23 01:29:51.523178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:29:51 2022] GET /compute/v2.1/os-snapshots/ae347260-35d9-47e4-bb1c-cc77e571f080 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:29:51.527658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3418be96-c46e-4ff3-a323-66d4151c8c65 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f78280>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:52.082289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3418be96-c46e-4ff3-a323-66d4151c8c65 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 202 len: 0 microversion: 2.1 time: 0.559481 Sep 23 01:29:52.083210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:29:51 2022] DELETE /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:29:52.095350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4129ebd7-119a-4e62-b7f1-894d15edc317 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f565e0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:52.224284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4129ebd7-119a-4e62-b7f1-894d15edc317 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 200 len: 344 microversion: 2.1 time: 0.136645 Sep 23 01:29:52.225095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:52 2022] GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 344 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:29:52.777268 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-565837343", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "networks": [{"uuid": "a0c19b36-6dcd-4567-812d-252de08febdf"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:29:53.157356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] validate_networks() for [('a0c19b36-6dcd-4567-812d-252de08febdf', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:29:53.247110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f195482e-16a0-4452-b1c3-b2c971f43bbf tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f56ca0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:53.349429 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-f195482e-16a0-4452-b1c3-b2c971f43bbf tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] HTTP exception thrown: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f195482e-16a0-4452-b1c3-b2c971f43bbf tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Request method failure captured: Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec HTTP/1.1 Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwDUEl6eBV-zMbEiSif1BVPVToP69d9-vE5y2B17x0F5Qr8xM_yJJSGtideTYceyG43TiC4QNiwJWHZulpPKiX1IeVx1N4CbRXcJbWSczkU3ZhXFLud69V1_BeFmhtCJcygZbEJojuGIPaPb0bXvUMUIWfV8ZGzjqlURhi_LGj1LJU Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:29:53.355977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c44d377f4f9749798e0a1c4ee9a6a5ee", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 0cdb50891eb44beba40f2bd9dbeb4759 Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'a40ec9f8-4fb3-49d1-a102-1086d73a40ec'} Sep 23 01:29:53.360591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. (HTTP 404) (Request-ID: req-25037a5f-1725-4c68-b3e9-16c8c6889b79) Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.362054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:53.364268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 01:29:53.366478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.369842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f195482e-16a0-4452-b1c3-b2c971f43bbf tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Returning 404 to user: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:29:53.382294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f195482e-16a0-4452-b1c3-b2c971f43bbf tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 404 len: 109 microversion: 2.1 time: 0.142027 Sep 23 01:29:53.388092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 14/28] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:53 2022] GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:29:53.415640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a8f1e5d7-c92d-46b0-af3d-7394c0a79212 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679edec10>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:53.579973 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-a8f1e5d7-c92d-46b0-af3d-7394c0a79212 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] HTTP exception thrown: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a8f1e5d7-c92d-46b0-af3d-7394c0a79212 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Request method failure captured: Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec HTTP/1.1 Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwDUEl6eBV-zMbEiSif1BVPVToP69d9-vE5y2B17x0F5Qr8xM_yJJSGtideTYceyG43TiC4QNiwJWHZulpPKiX1IeVx1N4CbRXcJbWSczkU3ZhXFLud69V1_BeFmhtCJcygZbEJojuGIPaPb0bXvUMUIWfV8ZGzjqlURhi_LGj1LJU Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:29:53.586396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c44d377f4f9749798e0a1c4ee9a6a5ee", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 0cdb50891eb44beba40f2bd9dbeb4759 Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'a40ec9f8-4fb3-49d1-a102-1086d73a40ec'} Sep 23 01:29:53.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. (HTTP 404) (Request-ID: req-19eeab4f-a133-4a4c-aef4-520a25017be7) Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.590401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:29:53.594407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 01:29:53.596590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.601267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.604043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a8f1e5d7-c92d-46b0-af3d-7394c0a79212 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Returning 404 to user: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:29:53.605961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a8f1e5d7-c92d-46b0-af3d-7394c0a79212 tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 404 len: 109 microversion: 2.1 time: 0.204280 Sep 23 01:29:53.607668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:29:53 2022] DELETE /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 109 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:29:53.623360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-27419485-515e-40c0-9a20-b5a38439e1ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Calling method '.version_select at 0x7f7679f568b0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:53.706870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-27419485-515e-40c0-9a20-b5a38439e1ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] HTTP exception thrown: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-27419485-515e-40c0-9a20-b5a38439e1ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Request method failure captured: Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec HTTP/1.1 Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwDUEl6eBV-zMbEiSif1BVPVToP69d9-vE5y2B17x0F5Qr8xM_yJJSGtideTYceyG43TiC4QNiwJWHZulpPKiX1IeVx1N4CbRXcJbWSczkU3ZhXFLud69V1_BeFmhtCJcygZbEJojuGIPaPb0bXvUMUIWfV8ZGzjqlURhi_LGj1LJU Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:29:53.713754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/c44d377f4f9749798e0a1c4ee9a6a5ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_c44d377f4f9749798e0a1c4ee9a6a5ee", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: c44d377f4f9749798e0a1c4ee9a6a5ee Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2112426975 Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 0cdb50891eb44beba40f2bd9dbeb4759 Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2112426975-project Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'a40ec9f8-4fb3-49d1-a102-1086d73a40ec'} Sep 23 01:29:53.716444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. (HTTP 404) (Request-ID: req-c80d42b5-d582-4abc-af68-0ddac99c5efb) Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.718949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:29:53.724070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 01:29:53.729651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. Sep 23 01:29:53.731720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:29:53.734689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-27419485-515e-40c0-9a20-b5a38439e1ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] Returning 404 to user: Volume a40ec9f8-4fb3-49d1-a102-1086d73a40ec could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:29:53.737264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-27419485-515e-40c0-9a20-b5a38439e1ed tempest-VolumesSnapshotsTestJSON-2112426975 tempest-VolumesSnapshotsTestJSON-2112426975-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec" status: 404 len: 109 microversion: 2.1 time: 0.122169 Sep 23 01:29:53.748713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 16/30] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:29:53 2022] GET /compute/v2.1/os-volumes/a40ec9f8-4fb3-49d1-a102-1086d73a40ec => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:29:55.622247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:29:55.623272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:29:55.623970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:29:55.625307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:29:55.625961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:29:55.667860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:29:55.668362 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:29:55.668801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:29:55.669555 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:29:55.670791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:29:55.671402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:29:55.898480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Getting quotas for project a90db67f8f74446b8cbd913a2a17c0b1. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:29:55.942772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Getting quotas for user 1f628503bfd24338b4a351d05a18f126 and project a90db67f8f74446b8cbd913a2a17c0b1. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:29:56.036624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:29:56.054275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:29:56.474446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3e4f23fc-afac-4c80-a476-eaf10d73d19c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.173725 Sep 23 01:29:56.483839 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 15/31] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:29:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:29:56.494429 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-25559701-11f3-44e6-b2c0-fa6c6dab41a1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:56.507196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-25559701-11f3-44e6-b2c0-fa6c6dab41a1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:29:57.067759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-25559701-11f3-44e6-b2c0-fa6c6dab41a1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:29:57.104516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-25559701-11f3-44e6-b2c0-fa6c6dab41a1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1214 microversion: 2.1 time: 0.618342 Sep 23 01:29:57.106007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 17/32] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:29:56 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1214 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:58.158225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3e321b9b-0bd8-4105-a97e-c3de4ed0a688 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:58.160360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3e321b9b-0bd8-4105-a97e-c3de4ed0a688 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:29:58.841532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3e321b9b-0bd8-4105-a97e-c3de4ed0a688 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:29:58.934743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3e321b9b-0bd8-4105-a97e-c3de4ed0a688 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1214 microversion: 2.1 time: 0.789335 Sep 23 01:29:58.942211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 16/33] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:29:58 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1214 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:29:59.971171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-768d8503-a822-4822-a49f-d6efeb734161 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:29:59.973254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-768d8503-a822-4822-a49f-d6efeb734161 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:00.189941 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-768d8503-a822-4822-a49f-d6efeb734161 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:00.240012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-768d8503-a822-4822-a49f-d6efeb734161 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1214 microversion: 2.1 time: 0.269879 Sep 23 01:30:00.243500 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 17/34] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:29:59 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1214 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:00.920098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f905df89-1623-48ce-ac1a-4f9a32829b87 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: .version_select at 0x7f7679f56670>, body: {"keypair": {"name": "tempest-keypair-1586208936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9kDMaCTpR/o/9g5IFqjfsAcimkJoF6vyvghAmivqVC63NUfKLtrWTXForTg/Q4mM3HPa+t2F17excqDn2tFy301CKswbpMAgDM9XGLYDVJNeksWGN4nDRR+vwio4DUFg=="}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:01.084543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-f905df89-1623-48ce-ac1a-4f9a32829b87 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for project 92e9b7f9904f437f91148da9fc521326. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:01.114263 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-f905df89-1623-48ce-ac1a-4f9a32829b87 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for user 1633ea35eda34ffe884140eaab1ae909 and project 92e9b7f9904f437f91148da9fc521326. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:01.345130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f905df89-1623-48ce-ac1a-4f9a32829b87 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.373602 Sep 23 01:30:01.345130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 18/35] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:29:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:01.544089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b9cd11c7-ead7-47da-9801-89cc5963c87c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: .version_select at 0x7f76795c1a60>, body: {"keypair": {"name": "tempest-keypair-1172169359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfOUnZAWp4H2yeWPGSevDorMe4r5SaatZHyERwN7JCRp9fcH6d5d89DcYQVedJraN168lWW/GiQHiBKkpdIg7Qcl3gCz35e93kYMQaFOCCLI94esHKKG5c8JT/+YMS3Eg=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:01.641029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-b9cd11c7-ead7-47da-9801-89cc5963c87c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for project cc926b4dede94c3b92441b0c610771f6. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:01.649839 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-b9cd11c7-ead7-47da-9801-89cc5963c87c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for user 62f175cb5d1e4ac8a0ee95cf7718837b and project cc926b4dede94c3b92441b0c610771f6. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:01.828874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b9cd11c7-ead7-47da-9801-89cc5963c87c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.036528 Sep 23 01:30:01.831305 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 18/36] 10.222.0.64 () {62 vars in 1200 bytes} [Fri Sep 23 01:30:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1043 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 23 01:30:01.846915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:01.854336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:01.892528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:01.893747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:01.895018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:01.901847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:01.901847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:01.901847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:02.513476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:02.578336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1998388207", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:02.609885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3f566338-973e-4f65-9c13-7ec747f4cabb tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1218 microversion: 2.1 time: 0.773610 Sep 23 01:30:02.614999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:01 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1218 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:02.822293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.network.neutron [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] validate_networks() for [('f7b971fd-945f-4624-ba90-e53784d63da6', None, None, None, None, None)] {{(pid=121763) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:30:03.650116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:03.656017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:03.700957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:03.706273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:03.706273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:03.710877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:03.719866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:03.723075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:04.087036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:04.151374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2a4ba9a0-c3c9-41e8-a172-1bcea997d0b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1266 microversion: 2.1 time: 0.503967 Sep 23 01:30:04.155130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 20/38] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:03 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1266 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:05.204998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:05.206253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:05.228809 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:05.229799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:05.231057 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:05.232596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:05.233452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:05.234565 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:05.580984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:05.607822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8557217f-7108-46e5-aae5-66110f863383 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1274 microversion: 2.1 time: 0.409648 Sep 23 01:30:05.611478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 21/39] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:05 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1274 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:06.649317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:06.650526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:06.663176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:06.706307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:06.710700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:06.723031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:06.729791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:06.734731 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:06.736941 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:07.063113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:07.121164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a86885d5-c1e4-414b-a84e-e4d0a58e883a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1272 microversion: 2.1 time: 0.483835 Sep 23 01:30:07.133835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:06 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1272 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:08.175165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:08.176787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:08.196310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:08.199151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:08.200200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:08.202631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:08.204693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:08.206231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:08.363147 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:08.385998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-beabdcf7-8343-4d24-909a-f64471ce8b13 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1272 microversion: 2.1 time: 0.215327 Sep 23 01:30:08.396970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 23/41] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:08 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:08.505841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:30:08.506703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:30:08.506703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:30:08.508867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:30:08.508867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:30:08.548822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:08.548822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:08.548822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:08.548822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:08.549311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:08.549311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:08.602299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:08.620212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for user da9978cab3fb4bdda39a2e4718ee2cc7 and project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:08.661826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Going to run 1 instances... {{(pid=121763) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:30:08.667047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:30:08.991195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ba7eaaef-826b-451e-8179-6746144271a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.651550 Sep 23 01:30:08.996174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 19/42] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:30:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 7659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:30:09.044077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9efe2f70-fda2-4012-92fa-3a3dfac0a04d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:09.053312 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9efe2f70-fda2-4012-92fa-3a3dfac0a04d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:09.410458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9efe2f70-fda2-4012-92fa-3a3dfac0a04d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:09.598357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:09.598357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:09.599297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9efe2f70-fda2-4012-92fa-3a3dfac0a04d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1222 microversion: 2.1 time: 0.447170 Sep 23 01:30:09.599297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 24/43] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:09 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1222 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:09.599528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:09.599528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:09.599528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:09.599528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:09.599999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:09.599999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:09.629631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-390848951", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62c29b3e-b2e8-4dd4-ada2-85bc80343af4"}], "security_groups": [{"name": "tempest-securitygroup--443375933"}], "key_name": "tempest-keypair-1586208936", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:09.912178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:09.939499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-88058827-bea2-452e-91a9-2ddbc8e582de tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1272 microversion: 2.1 time: 0.503649 Sep 23 01:30:09.944939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 20/44] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:09 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1272 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:09.996296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] validate_networks() for [('62c29b3e-b2e8-4dd4-ada2-85bc80343af4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:30:10.370161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2068756560", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:10.682163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.network.neutron [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] validate_networks() for [('f7b971fd-945f-4624-ba90-e53784d63da6', None, None, None, None, None)] {{(pid=121763) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:30:11.660615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:30:11.661534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:30:11.662874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:30:11.664055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:30:11.665501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:30:11.728976 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:11.737205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:11.739161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:11.747217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:11.756475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:11.758020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:11.848194 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for project 92e9b7f9904f437f91148da9fc521326. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:11.880563 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for user 1633ea35eda34ffe884140eaab1ae909 and project 92e9b7f9904f437f91148da9fc521326. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:12.104396 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:30:12.158531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:30:12.849344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0e62bb82-42e7-4279-8179-54374319aab8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.225610 Sep 23 01:30:12.859788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 25/45] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:30:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:30:12.885066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:12.889227 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:12.993788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:13.001907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:13.007711 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:13.014957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:13.018340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:13.020550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:14.167903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:14.193097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-34fbe587-61d4-45d7-b670-8993c83697ab tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.331097 Sep 23 01:30:14.194459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 26/46] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:12 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:14.202846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-10f2de50-5f17-40e6-91e5-fc8ae1999963 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:14.216382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-10f2de50-5f17-40e6-91e5-fc8ae1999963 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:14.648972 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-10f2de50-5f17-40e6-91e5-fc8ae1999963 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:14.674480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-10f2de50-5f17-40e6-91e5-fc8ae1999963 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1237 microversion: 2.1 time: 0.477281 Sep 23 01:30:14.682438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 27/47] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:14 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1237 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:15.250879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:15.255208 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:15.292168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:15.293818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:15.300579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:15.305588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:15.308329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:15.311868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:16.102630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:16.158003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-faea4be1-9ead-4de3-a4df-c1ccb5ea9031 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.918275 Sep 23 01:30:16.163436 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 28/48] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:15 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:16.219590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9f9a719d-5400-421d-8209-36f2423ddafb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:16.223216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9f9a719d-5400-421d-8209-36f2423ddafb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:16.564201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9f9a719d-5400-421d-8209-36f2423ddafb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:16.575544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9f9a719d-5400-421d-8209-36f2423ddafb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1237 microversion: 2.1 time: 0.387045 Sep 23 01:30:16.575544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 29/49] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:16 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1237 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:16.590817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1952777950", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd195584-9c0f-4bc1-8f70-84ad33facee8"}], "security_groups": [{"name": "tempest-securitygroup--1768606471"}], "key_name": "tempest-keypair-1172169359", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:17.118275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] validate_networks() for [('fd195584-9c0f-4bc1-8f70-84ad33facee8', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:30:18.166935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:30:18.171380 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:30:18.174067 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:30:18.180882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:30:18.181825 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:30:18.266603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:18.268214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:18.270430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:18.280732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:18.284969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:18.288772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:18.558958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:18.595488 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for user da9978cab3fb4bdda39a2e4718ee2cc7 and project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:18.710323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Going to run 1 instances... {{(pid=121763) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:30:18.713717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:30:19.126576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-070fe7ae-bc61-4f50-a905-c67f2bfbc052 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 8.759008 Sep 23 01:30:19.133139 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 21/50] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:30:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 8774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:30:19.171424 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:19.187648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:19.317516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:19.318405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:19.318946 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:19.319783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:19.320321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:19.320755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:20.501179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:20.521879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5aad5e65-19b0-4647-985d-b107d0aa2a94 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.384308 Sep 23 01:30:20.540125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 22/51] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:19 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:20.546856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:20.549500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:20.603328 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:30:20.610579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:30:20.611509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:30:20.612503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:30:20.613175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:30:20.617134 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=7 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:20.622221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:20.624343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:20.636048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:20.644450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:20.646447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:20.650240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:20.655310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=27 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:20.681713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:20.685808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:20.692341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:20.699835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:20.703388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:20.708660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:20.756460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=47 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:20.828069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for project cc926b4dede94c3b92441b0c610771f6. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:30:20.840671 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for user 62f175cb5d1e4ac8a0ee95cf7718837b and project cc926b4dede94c3b92441b0c610771f6. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:30:20.886915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:30:20.892441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:30:21.105056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:21.198134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-22ec9cc8-36b3-421f-aa55-d95916add0d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1297 microversion: 2.1 time: 0.614000 Sep 23 01:30:21.207111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 23/52] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:20 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1297 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:21.246971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cb05ccc4-f07d-477f-8728-74fe81a8d79b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:21.257013 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cb05ccc4-f07d-477f-8728-74fe81a8d79b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:21.258608 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a2520a08-ecdd-4907-b178-6bcd897f9612 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.673280 Sep 23 01:30:21.260034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 30/53] 10.222.0.64 () {62 vars in 1188 bytes} [Fri Sep 23 01:30:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 4687 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 01:30:21.290887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:21.291351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:21.599379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:21.615807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:21.629488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:21.635210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-cc1d423a-ad13-4734-a668-fd2b29dfd864 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1282 microversion: 2.20 time: 0.354858 Sep 23 01:30:21.641278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 31/54] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:21 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:21.652625 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:21.664519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:21.693091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:21.698686 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:21.704678 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:21.711011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:21.722920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:21.722920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:21.835074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb05ccc4-f07d-477f-8728-74fe81a8d79b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:21.851452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cb05ccc4-f07d-477f-8728-74fe81a8d79b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1222 microversion: 2.1 time: 0.639511 Sep 23 01:30:21.853819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 24/55] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:21 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1222 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:22.194226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:22.216498 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-894b753c-ebe3-4526-8d92-cdfc4d809aa7 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.572129 Sep 23 01:30:22.219433 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 32/56] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:21 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:22.241895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:22.245268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:22.295169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:22.296936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:22.304084 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:22.305486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:22.306367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:22.312810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:22.694411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:22.697303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:23.189174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:23.215897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c1284036-fecc-4766-9ee3-fc3dac389357 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1295 microversion: 2.1 time: 0.987461 Sep 23 01:30:23.228529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 25/57] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:22 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1295 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:23.244509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:23.269399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:23.285286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:23.292237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:23.294975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:23.298379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:23.304505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:23.304505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:23.363664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:23.394401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:23.406913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:23.419296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-befad83f-9390-428d-a965-779e7c275041 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1282 microversion: 2.20 time: 0.731299 Sep 23 01:30:23.422604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 33/58] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:22 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1282 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:23.442467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:23.446001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:23.474898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:23.481085 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:23.481973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:23.482791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:23.508852 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:23.514824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:23.755996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:23.780081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-377bb505-597c-4c0c-a026-d24cd2c98f7b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1218 microversion: 2.1 time: 0.549642 Sep 23 01:30:23.781579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 26/59] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:23 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1218 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:24.074502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2166a98-2e71-4367-aa3a-9064cb15ae82", "tag": "2731a03e-93f1-42a0-9954-08f752288652"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:24.183799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.184771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.188420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.248555 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:24.253264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Creating event network-changed:2731a03e-93f1-42a0-9954-08f752288652 for instance d2166a98-2e71-4367-aa3a-9064cb15ae82 on hv-cinder-84914 Sep 23 01:30:24.254222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 01:30:24.262369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bbc52d5d-2834-43eb-920e-60363164435a req-d05617e3-feb8-4b9d-bd8b-c7125f1e1f24 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 01:30:24.269509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.271993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.275712 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.279194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.283837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.284942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.329989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-901bb44f-5647-4a60-98ec-543d28f314f0 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.905486 Sep 23 01:30:24.331061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 34/60] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:23 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:24.333593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.compute.rpcapi [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 01:30:24.335722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] Releasing lock "compute-rpcapi-router" {{(pid=121763) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 01:30:24.403290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-88e2bab1-d5b9-4cc9-a64c-9442d47d531f None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.610774 Sep 23 01:30:24.404852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 27/61] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:24.438580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:24.439432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:24.469589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.476121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.476584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.477387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.477967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.478392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.492536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:24.503284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:24.536813 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.537536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.538093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.538849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.539314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.539845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.769161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:24.805251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-92fe1fce-d6db-4117-9f8e-48f6a7ef44f6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1295 microversion: 2.1 time: 0.463305 Sep 23 01:30:24.817926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:24.820707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 35/62] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:24 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1295 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:24.838420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:24.839292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:24.842594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:24.858180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:24.878179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-454ec315-0b13-4758-b04c-58773286abd8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1286 microversion: 2.20 time: 0.403370 Sep 23 01:30:24.879371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.882477 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.883468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 28/63] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:24 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1286 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:24.887513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:24.890239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:24.891194 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:24.893268 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:25.166182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:25.191533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b88c5889-dae0-4245-9440-8e7a222f1a76 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1274 microversion: 2.1 time: 0.366968 Sep 23 01:30:25.198075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 36/64] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:24 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1274 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:25.381474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:25.382569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:25.419991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:25.420882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:25.426632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:25.428370 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:25.434441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:25.435610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:25.846221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:25.848640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:25.862319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:25.863826 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:25.865545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:25.867209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:25.868543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:25.869772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.018811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.023569 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.034441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1e60e6dd-ff76-4b3d-8ae9-78d03e1e47fd tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.659865 Sep 23 01:30:26.035301 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 29/65] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:25 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:26.060547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:26.062086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-de6bfd59-008b-405e-98bd-81bac1f46955 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1295 microversion: 2.1 time: 0.222329 Sep 23 01:30:26.065542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 37/66] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:25 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1295 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:26.066004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:26.098478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:26.099813 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:26.101002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.102672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:26.103484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:26.106682 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.262915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:26.263395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.263595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:26.287836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.294380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:26.295281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:26.296545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.296730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.298144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:26.300190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f3c4809c-3f85-480b-a0b0-97b51aa89b55 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1278 microversion: 2.20 time: 0.257724 Sep 23 01:30:26.300801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:26.302068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.302741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 30/67] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:26 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1278 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:26.543222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:26.572397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f5e2ef62-9d4a-4a70-8db4-7234f9b113b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1282 microversion: 2.1 time: 0.329731 Sep 23 01:30:26.576119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 38/68] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:26 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1282 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:26.680652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75f4424-87db-4f88-a745-e8071a1a3404", "tag": "fbe29d32-612d-4c37-bdda-6d63f1cd6de4"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:26.698014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:26.704672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:26.705634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:26.710827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:26.782906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] Creating event network-changed:fbe29d32-612d-4c37-bdda-6d63f1cd6de4 for instance a75f4424-87db-4f88-a745-e8071a1a3404 on hv-cinder-84914 Sep 23 01:30:26.794375 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-7cacac27-05e3-4ed2-abe5-953e3603580c req-621e78da-0ed3-4b0e-9f5d-331bafcfd6d0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283558 Sep 23 01:30:26.795482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 31/69] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:30:27.078912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:27.079863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:27.098114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.099150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.100425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.102423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.103685 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.104655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.109435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:27.110423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:27.140327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.141226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.142034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.143371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.152162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.152962 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.401020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.430004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f5fe888d-fd01-490d-96f4-62fa85ea4820 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.356408 Sep 23 01:30:27.433825 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 39/70] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:27 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:27.445790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:27.446824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:27.489462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.494089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.494089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.494089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.494893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.496199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.632358 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.653954 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.662370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.672198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.680796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-56f243db-7fcd-4236-94cc-356768775410 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1278 microversion: 2.20 time: 0.244526 Sep 23 01:30:27.683653 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 40/71] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:27 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1278 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:27.693484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:27.698964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:27.701036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e5794fed-6117-4d73-a647-a28c1e523f90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.596918 Sep 23 01:30:27.714348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 32/72] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:27 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:27.740163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.758913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.758913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.758913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:27.758913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:27.759346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:27.916901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:27.935399 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-82189585-2ebe-47c9-b10b-0860cca3c77a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1282 microversion: 2.1 time: 0.249794 Sep 23 01:30:27.937104 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 41/73] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:27 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:28.481746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:28.496589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:28.533438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:28.535028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:28.539688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:28.564574 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:28.573385 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:28.582088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:28.729945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:28.744000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:28.764334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:28.765660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:28.766751 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:28.773055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:28.774945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:28.785079 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:29.563005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:29.563005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:29.564580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:29.571626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-459e2518-c055-49a7-8ba4-a8ecc0c062af tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1334 microversion: 2.20 time: 0.835834 Sep 23 01:30:29.573248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 42/74] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:28 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1334 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:29.616684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:29.617867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:29.663612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:29.664766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:29.670361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:29.675744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:29.676782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:29.679696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:30.324087 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:30.360675 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e4c6cb91-f497-4de2-915f-5b8c34f95a07 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.785177 Sep 23 01:30:30.381196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 43/75] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:29 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:30.426105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:30.427293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:30.452540 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:30.454264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:30.455343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:30.457026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:30.459249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:30.460511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:30.538367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:30.588888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9bfbc488-8dd4-41f2-946d-fa9b298b9529 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 2.115548 Sep 23 01:30:30.608932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 33/76] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:28 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:30.661284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:30.676309 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:30.745826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:30.751616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:30.753723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:30.756351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:30.757173 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:30.758325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:30.760067 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:30.869221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:30.892908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-25745ee9-62e4-48bd-bd2f-4dd1bcfd958f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1292 microversion: 2.1 time: 0.488025 Sep 23 01:30:30.895335 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 44/77] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:30 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1292 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:31.432740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:31.441251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:31.451065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:31.497770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:31.503749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:31.504455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:31.519249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:31.520395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:31.521149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:31.544087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:31.550976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:31.558681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3a87aa48-4d6b-4c9d-8b82-a03cbf2be5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1334 microversion: 2.20 time: 0.935370 Sep 23 01:30:31.560089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 34/78] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:30 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1334 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:31.645350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:31.646594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:31.707181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:31.709914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:31.721194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:31.724188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:31.737065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:31.740486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:31.918109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=20 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:33.388868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=9 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:34.166213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:34.206628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-88e00a1c-5ac8-4855-bf92-d71ba4f96bca tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 2.797798 Sep 23 01:30:34.224992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 45/79] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:31 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:34.281162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:34.286144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:34.328232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=6 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:34.350040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:34.371229 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:34.374141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:34.378960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:34.382721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:34.394099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:34.647903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:34.676239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e857e623-c97d-41bd-8baa-dd9b2edbebde tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1280 microversion: 2.1 time: 0.447083 Sep 23 01:30:34.716163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 46/80] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:34 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1280 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:34.718704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:34.719507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:34.761601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:34.764299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:34.767225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:34.771051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:34.772529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:34.774965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:35.086246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:35.101470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:35.110037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:35.111479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-35a5cf3f-0919-428c-bebf-ff759610d464 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1340 microversion: 2.20 time: 0.404894 Sep 23 01:30:35.143988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 47/81] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:34 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1340 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:35.259648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:35.260810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:35.296689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:35.302324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:35.302324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:35.303903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:35.314714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:35.314714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:35.767451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:35.790024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-750a3b24-9f6f-4d90-99ec-7978048566a9 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 4.153026 Sep 23 01:30:35.795807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 35/82] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:31 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 4160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:35.838607 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:35.841450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:35.862149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:35.872499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:35.873468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:35.874595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:35.875408 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:35.877974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:36.664896 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:36.759794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b7e87bf4-b071-4f53-9745-532754329da2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 1.501956 Sep 23 01:30:36.762121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 48/83] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:35 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:36.829804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:36.837872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:36.895225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:36.895225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:36.895225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:36.898971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:36.903334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:36.904927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:36.982976 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:37.453698 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:37.479842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=87 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:37.487347 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fb764cdb-88f0-476c-a49a-56fbc31bc2db tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 1.689392 Sep 23 01:30:37.495645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 36/84] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:35 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:37.508904 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:37.510643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:37.541716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:37.545598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:37.546606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:37.546606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:37.549100 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:37.557131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:37.558493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:37.597915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:37.602177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:37.619116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9d75997a-a19b-4019-8ece-76670c3fd677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1340 microversion: 2.20 time: 0.847012 Sep 23 01:30:37.664610 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 49/85] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:36 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1340 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:37.815385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:37.832151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:37.867112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:37.868642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:37.876208 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:37.878463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:37.881561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:37.882475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:38.685901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:38.705637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ce1c1a09-7b2f-4d7f-b8e0-e3c69556a0ac tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.210618 Sep 23 01:30:38.744712 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 37/86] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:37 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:38.772810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:38.774696 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:38.809887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:38.813846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:38.823779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:38.830154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:38.830982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:38.872565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:39.063467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:39.083770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1db3157a-9562-477a-8386-d5291b8b568a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 1.277746 Sep 23 01:30:39.100397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 50/87] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:37 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:39.125068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:39.128148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:39.146496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:39.147582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:39.148747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:39.150475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:39.151322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:39.152474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:39.321543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:39.339738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c9d5d9f9-9732-4c5e-8775-3af74b7cb95b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.593023 Sep 23 01:30:39.342203 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 38/88] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:38 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:39.451351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ce20b4-a04e-4dc8-b694-50be8ee53310", "tag": "c8abb555-0222-4db9-8cfd-ae8b447de34c"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:39.491173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:39.493011 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:39.494300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:39.516728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] Creating event network-changed:c8abb555-0222-4db9-8cfd-ae8b447de34c for instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 on hv-cinder-84914 Sep 23 01:30:39.535231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-abc5042e-aa74-465e-9ce3-603e1d664d2b req-3b7168b4-2e6f-4add-aa26-864dfe7c7df1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094074 Sep 23 01:30:39.535231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 39/89] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:39.765938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:39.770405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:39.806806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:39.809070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:39.813854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:39.818645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:39.828940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:39.830327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:40.409562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:40.426517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-59acb90b-0b80-4b13-a39f-0459b8af2dfe tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.673812 Sep 23 01:30:40.432222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 40/90] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:39 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:40.449674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:40.461616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:40.462859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:40.490568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:40.490568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:40.490568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:40.495941 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:40.500520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:40.506119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:40.515195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-613c13c2-d45b-404a-b41c-cf5df85277b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 1.410531 Sep 23 01:30:40.515195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 51/91] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:39 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:40.531645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:40.532624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:40.534156 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:40.544743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:40.564473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:40.566030 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:40.567102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:40.573404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:40.574717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:40.581674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:41.193450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:41.224034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e3d819cd-5af0-4795-911a-34b9d333d933 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.783422 Sep 23 01:30:41.233530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 41/92] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:40 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:41.469518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:41.473421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:41.494268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:41.498779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:41.504903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:41.506317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:41.507205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:41.510493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:42.326506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:42.356238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5ea8ab21-1c8e-458b-9f99-0757eb734ac1 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.892114 Sep 23 01:30:42.367809 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:42.374487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 42/93] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:41 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:42.414413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:42.417715 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7a0ee33e-4ff4-4605-9eb1-e854418beaa6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 1.899568 Sep 23 01:30:42.423284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 52/94] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:40 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 1907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:42.434358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:42.448196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:42.454743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:42.479590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:42.482348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:42.494858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:42.496749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:42.497692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:42.501351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:42.503651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:42.510377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:42.513588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:42.517032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:42.525113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:42.525113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.034966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:43.076954 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3fcb82ff-49ca-4655-92a8-31ac99c37a7c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.651052 Sep 23 01:30:43.085372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 53/95] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:42 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:43.361409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3604d0-0f5e-4363-ae25-1fa0bbbb900f", "tag": "3c1b60d8-8221-4813-9c15-069d1c74ae40"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:43.411935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.417845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.420775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.480336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Creating event network-changed:3c1b60d8-8221-4813-9c15-069d1c74ae40 for instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f on hv-cinder-84914 Sep 23 01:30:43.481342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 23 01:30:43.481974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c0b68c42-14a3-42aa-b5ec-895be827bd5c req-e27168e9-7e78-4303-9686-518d76d4fb0a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 23 01:30:43.485094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.486020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.486710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.488125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.489793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.490691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.512289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.compute.rpcapi [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 23 01:30:43.512289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] Releasing lock "compute-rpcapi-router" {{(pid=121762) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 23 01:30:43.553430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0997db5c-a80e-40a6-a263-72946f05d6de None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198116 Sep 23 01:30:43.558174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 54/96] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:30:43.584790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:43.586393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:43.606075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.606978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.610724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.611981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.612689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.615397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.762761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:43.777662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:43.779806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:43.782681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1aa098c2-a96b-4044-87be-46a032448273 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 1.403572 Sep 23 01:30:43.784568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 43/97] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:42 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:43.798529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:43.799687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:43.829406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.830205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.830829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:43.832746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:43.833237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:43.833694 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:44.386443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:44.398745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d8083b50-ba68-4a01-8a0e-21a1c511aaa2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.612735 Sep 23 01:30:44.419744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 44/98] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:43 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:44.432750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:44.434133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:44.448829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:44.450170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:44.453919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:44.457999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:44.461706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:44.467116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:44.758124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:44.770845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c0578676-c91c-4514-bc8f-182cc8211971 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.205646 Sep 23 01:30:44.805182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 55/99] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:43 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:44.817053 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:44.824619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:44.837404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:44.838308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:44.839024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:44.841273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:44.842105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:44.843457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:44.884781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:44.908905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b37de7e7-b192-42e7-a042-769638ad3b28 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.485981 Sep 23 01:30:44.909948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 45/100] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:44 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:45.398831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75f4424-87db-4f88-a745-e8071a1a3404", "name": "network-vif-plugged", "status": "completed", "tag": "fbe29d32-612d-4c37-bdda-6d63f1cd6de4"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:45.421885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:45.434601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.436006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.437989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:45.452692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:45.464509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:45.468292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-025b6c77-47dc-4554-baa0-4a7dd84460dc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.658834 Sep 23 01:30:45.492833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 56/101] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:44 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:45.510708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] Creating event network-vif-plugged:fbe29d32-612d-4c37-bdda-6d63f1cd6de4 for instance a75f4424-87db-4f88-a745-e8071a1a3404 on hv-cinder-84914 Sep 23 01:30:45.515277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:45.522782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:45.538608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-18da0d12-bb8b-4a76-bf09-b30693ae02e6 req-ceb03668-e03d-4b88-a169-1693991884e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.295687 Sep 23 01:30:45.543990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.544507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.544997 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:45.546353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.546821 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.547409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:45.550225 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 46/102] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:30:45.758151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:45.807207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.808880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.809920 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:45.888327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] Creating event network-changed:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:30:45.913959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-eb90768c-e53e-436e-8a9d-ae853d9bda6b req-fdffe652-3133-4c5f-b09c-94d41923eeef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.170781 Sep 23 01:30:45.924645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 47/103] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:30:45.940879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:45.946986 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:45.973708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.980450 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.983094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:45.984793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:45.986231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:45.987294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:46.778525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:46.838452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-aecaa535-fca1-45a4-ad92-008a5d12dc60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 1.343367 Sep 23 01:30:46.841427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 57/104] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:45 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:46.866047 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:46.870275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:46.929733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:46.931763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:46.940758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:46.942252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:46.947834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:46.950981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:47.051115 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:47.100626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-12916f18-2c1d-40df-823d-f69d04594c3c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.172983 Sep 23 01:30:47.106936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 48/105] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:45 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:47.124605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:47.132711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:47.157586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:47.159022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:47.160194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:47.161910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:47.170173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:47.174298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:47.812045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:47.864132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6ff5b94e-7ed5-42aa-a35f-df31c7af925c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 1.013881 Sep 23 01:30:47.869515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 58/106] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:46 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:47.882113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2166a98-2e71-4367-aa3a-9064cb15ae82", "name": "network-vif-plugged", "status": "completed", "tag": "2731a03e-93f1-42a0-9954-08f752288652"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:47.910916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:47.912373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:47.913780 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:47.915192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:47.963464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:47.969866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] Creating event network-vif-plugged:2731a03e-93f1-42a0-9954-08f752288652 for instance d2166a98-2e71-4367-aa3a-9064cb15ae82 on hv-cinder-84914 Sep 23 01:30:47.983812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:47.983812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-53e0eeb6-4cca-418e-b2ff-bb576310222d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.864075 Sep 23 01:30:47.983812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 49/107] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:47 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:47.984300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-da664d32-8248-4401-a452-f92b906693b6 req-1b26ae89-c901-4576-848a-b05e4537acce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112306 Sep 23 01:30:47.991710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:47.993546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:47.993770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 59/108] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:48.018451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.019829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.021057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:48.022768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.031929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.033246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:48.145454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:48.152739 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:48.179440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.181074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.184367 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:48.189441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.194780 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.195952 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:48.619898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:48.649160 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e873dcf4-626d-41a0-8ed0-08345e24318c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.671493 Sep 23 01:30:48.666841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 50/109] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:47 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:48.933868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:48.935434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:48.967121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.968417 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.970089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:48.971900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:48.973356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:48.977869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:49.241038 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:49.277887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-034d8a3e-6c9a-4d0e-8e5d-ff65ecfacc5f tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 1.146024 Sep 23 01:30:49.282602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 60/110] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:48 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:49.303878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:49.319205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:49.366081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:49.373189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:49.379360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:49.381160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:49.389532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:49.392787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:49.526992 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:49.548394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0df98f4b-ef1d-47de-965a-3279ce07188e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.639897 Sep 23 01:30:49.551109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 51/111] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:48 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:49.697426 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:49.699608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:49.729749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:49.731730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:49.732931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:49.737206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:49.739747 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:49.741250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:50.350713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:50.387032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:50.398692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:50.412355 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dc0cb9bc-06db-4e87-9ebb-0a4c63f8324f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 1.115496 Sep 23 01:30:50.415076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 61/112] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:49 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:50.438790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ce20b4-a04e-4dc8-b694-50be8ee53310", "name": "network-vif-plugged", "status": "completed", "tag": "c8abb555-0222-4db9-8cfd-ae8b447de34c"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:50.484449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:50.489162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:50.494287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:50.549178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] Creating event network-vif-plugged:c8abb555-0222-4db9-8cfd-ae8b447de34c for instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 on hv-cinder-84914 Sep 23 01:30:50.584214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-a93813d1-4d9a-44fb-9df6-b29f31055d0c req-6ee4c3e6-34ba-499a-8de7-58c552d5d96b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163251 Sep 23 01:30:50.587865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 62/113] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:50.635743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:50.640259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:50.645008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:50.677693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:50.683471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:50.688622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:50.689808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-33febd2a-3562-4b24-94b7-4929c8f7ce03 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 1.000571 Sep 23 01:30:50.692464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 52/114] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:49 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:50.710753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:50.711755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:50.726431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:50.726925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:50.739259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:50.755333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:50.757228 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:50.758782 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:50.765597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:50.767088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:50.768000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:51.281318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:51.317397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e802115f-5f3c-44fe-a485-59b779ab3266 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.621028 Sep 23 01:30:51.338294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:51.360556 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 53/115] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:50 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:51.392787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b3eb67a1-885f-47e3-a296-030970acf144 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.797971 Sep 23 01:30:51.395667 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 63/116] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:50 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:51.481733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:51.486057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:51.519056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:51.521260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:51.522278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:51.528675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:51.529641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:51.534035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:51.738354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:51.740001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:51.754871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:51.756118 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:51.760575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:51.763928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:51.767135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:51.768365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:52.230522 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:52.272152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:52.290237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:52.292966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2c800367-5041-44d9-b9f5-1caac228833b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.829698 Sep 23 01:30:52.306650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 54/117] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:51 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:52.386091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:52.387957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:52.410068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:52.416427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:52.416427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:52.416427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:52.416427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:52.416833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:52.460355 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:52.464399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:52.485658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-95981a78-5959-4f89-86a8-65e323da42a9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.754863 Sep 23 01:30:52.494699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 64/118] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:51 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:52.506198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:52.507093 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:52.517005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:52.530395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:52.530931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:52.531401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:52.532413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:52.532919 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:52.533405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:53.145989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:53.164316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1e0d7a28-c6f8-40f1-b2cb-dd7bc60b8d7b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1314 microversion: 2.1 time: 0.675046 Sep 23 01:30:53.167005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 65/119] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:52 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:53.185614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:53.249307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d7dce85e-3885-4a6f-aeda-d31a55ea4790 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.876477 Sep 23 01:30:53.265740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 55/120] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:52 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:53.365193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:53.369228 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:53.390906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:53.392378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:53.393281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:53.394242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:53.394934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:53.395411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:53.509257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:53.541297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:53.546907 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:53.578864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:53.580186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:53.581473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:53.583304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:53.584509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:53.586142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:53.860084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:53.878169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:53.881531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:53.884520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-af5622c4-e8b0-48ca-96d4-4ae1d9214770 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.544011 Sep 23 01:30:53.885902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 66/121] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:53 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:54.013401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:54.030780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-58ab7634-a2f9-4d71-b5eb-c1d257e4b919 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.498835 Sep 23 01:30:54.055212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 56/122] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:53 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:54.214845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:54.216306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:54.271081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.272352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.273294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.276291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.281385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.284748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.310038 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:54.320393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:54.368987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.369888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.370939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.372738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.376960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.378345 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.777672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:54.788371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:54.822601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1b39dff2-e161-40e7-8a4f-74a99448a750 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1499 microversion: 2.1 time: 0.615948 Sep 23 01:30:54.828489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 67/123] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:54 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1499 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:54.928223 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:54.929387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:54.951060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.954922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.957548 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.960893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:54.963963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:54.975511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:54.981518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:55.026305 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-722c47eb-d6b4-42e6-90fe-f37175dd90dd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1362 microversion: 2.1 time: 0.735255 Sep 23 01:30:55.043595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 57/124] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:54 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1362 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:55.092015 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:55.095411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:55.131008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:55.142110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:55.143768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:55.145356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:55.146457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:55.147243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:55.503833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:55.528006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8a4771f7-1f3e-44e2-be85-99376bf4dc9b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.459228 Sep 23 01:30:55.530870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 58/125] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:55 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:55.542984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3604d0-0f5e-4363-ae25-1fa0bbbb900f", "name": "network-vif-plugged", "status": "completed", "tag": "3c1b60d8-8221-4813-9c15-069d1c74ae40"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:55.567438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:55.569567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:55.571178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:55.617565 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:55.628557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] Creating event network-vif-plugged:3c1b60d8-8221-4813-9c15-069d1c74ae40 for instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f on hv-cinder-84914 Sep 23 01:30:55.641685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-db1f8c37-bfe0-43b6-950f-ed8cef2198ce req-2b3b02e2-6829-4628-8d71-575d0c0c76d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107997 Sep 23 01:30:55.643783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 59/126] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:55.648163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:55.652662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:55.655022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2531b3f7-82ff-45fa-9010-7ebce3adbcb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.733984 Sep 23 01:30:55.657241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 68/127] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:54 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:56.097028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:56.097028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:56.097028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.097028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.098246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:56.098246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.098246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.098246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:56.588807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:56.597527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:56.628344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.629733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.630860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:56.631542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:56.635933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.638656 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.646299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:56.671165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-46853e50-924d-4995-abc2-049810dc1f9d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1548 microversion: 2.1 time: 0.596860 Sep 23 01:30:56.676581 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 60/128] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:56 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1548 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:56.711584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:56.716716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:56.745140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.746431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.747472 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:56.749658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:56.750736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:56.752033 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.006575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:57.024282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b86dbad0-098a-4ebc-ac89-d264a77a0cd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.451638 Sep 23 01:30:57.026064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 69/129] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:56 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:30:57.051255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:57.052542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:57.068331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:57.069214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:57.069925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.071271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:57.074414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:57.079955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.116976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:57.155726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:57.159713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:57.162854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-76024c75-2e46-45ae-a67b-eecd9ac8a38b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.460485 Sep 23 01:30:57.167218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 61/130] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:56 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:57.294700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-167b0659-f517-48f4-ac57-ad0ce84b900b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.266535 Sep 23 01:30:57.295258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 70/131] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:30:57 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:57.695327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "name": "network-vif-plugged", "status": "completed", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:57.731078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=62 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:30:57.752134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:57.761464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:57.764013 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.779098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24ec2815-5cb5-4403-8b85-3b412715db55"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:30:57.787280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:57.790363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] Creating event network-vif-plugged:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:30:57.798604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:57.799767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:57.800579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.801243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-5f9b7093-6cc3-43d8-8284-a2a17537d207 req-0277f04f-ca2a-4473-8481-b76013e13c2b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117188 Sep 23 01:30:57.802382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:57.803540 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:57.804444 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:57.807619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 62/132] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:30:58.078169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:58.079343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:58.097344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:58.098334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:58.099021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:58.100573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:58.102105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:58.102933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:58.814934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:58.838657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3d5e43a3-ed07-4a8f-b57a-0da8b66d64b0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1322 microversion: 2.1 time: 0.770144 Sep 23 01:30:58.840095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 63/133] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:58 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1322 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:30:58.846506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:58.847922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:58.858796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:58.859636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:58.860478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:58.862269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:58.862986 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:58.863708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:59.117459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:59.129141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:59.136453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:30:59.140092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4d535f2d-f4b3-4bdd-8297-a0cbfdc14842 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.297422 Sep 23 01:30:59.144391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 64/134] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:30:58 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:30:59.892207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:30:59.894527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:30:59.912846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:59.912846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:59.912846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:30:59.912846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:30:59.913707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:30:59.914618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.121286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:00.139174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-10426d33-f9a3-44d1-b27d-a2cac030d0ca tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1517 microversion: 2.1 time: 0.254781 Sep 23 01:31:00.140787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 65/135] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:30:59 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1517 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:00.152137 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09ce20b4-a04e-4dc8-b694-50be8ee53310", "tag": "c8abb555-0222-4db9-8cfd-ae8b447de34c"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:00.167667 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:00.168647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:00.169599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.185736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] Creating event network-changed:c8abb555-0222-4db9-8cfd-ae8b447de34c for instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 on hv-cinder-84914 Sep 23 01:31:00.193151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-6614eeac-9e1c-485b-b533-5bf3eb9f4114 req-32b9a4a1-2123-4ea5-84e8-8a07270f28fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044638 Sep 23 01:31:00.194068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 66/136] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:00.203233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:00.206544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:00.215247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:00.216235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:00.217077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.218214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:00.219845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:00.219845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.302234 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'flavor' on Instance uuid 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:31:00.338519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4bac4e9f-646c-4546-95f1-c24b377943c8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "POST /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.565590 Sep 23 01:31:00.342945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 71/137] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:30:57 2022] POST /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82/os-volume_attachments => generated 194 bytes in 2573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:00.357427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:00.361806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:00.398317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:00.398317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:00.398317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.398317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:00.400617 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:00.400617 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:00.891060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:00.909832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:00.909832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:00.909832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5f908e8b-f547-4791-9372-0333d351f182 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1408 microversion: 2.20 time: 0.563246 Sep 23 01:31:00.912199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 72/138] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:31:00 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:31:01.139710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d64d2d08-347f-41f6-996f-d838be88cfe8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f/action" status: 200 len: 32 microversion: 2.1 time: 0.943411 Sep 23 01:31:01.152278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 67/139] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:31:00 2022] POST /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f/action => generated 32 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:31:01.154175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:01.155043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:01.164386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:01.165144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:01.166514 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:01.167522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:01.168141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:01.168842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:01.456045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:01.473468 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c80ffaf9-0500-4440-8c5a-5eb81d677bcf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.324923 Sep 23 01:31:01.474873 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 73/140] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:01 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:01.956014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:01.957471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:01.965990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:01.966860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:01.967609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:01.968927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:01.969716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:01.970323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:02.461285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:02.475451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:02.482927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:02.489536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-dca69beb-1738-4d09-8992-55006d8f8e90 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1600 microversion: 2.20 time: 0.540683 Sep 23 01:31:02.497355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 68/141] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:31:01 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1600 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:31:02.511483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:02.512978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:02.527437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:02.529155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:02.537840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:02.538431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:02.538819 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:02.539524 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:02.543298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:02.543921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:02.544519 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:02.545655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:02.546457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:02.550600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:02.551186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:02.555278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:02.880959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-49a64a63-501c-4a50-928f-9b8fc7477d0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.356204 Sep 23 01:31:02.891174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 69/142] 10.222.0.64 () {60 vars in 1316 bytes} [Fri Sep 23 01:31:02 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-interface => generated 284 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:31:03.176663 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:03.187652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f6cf8b97-56fe-4410-b1f4-450a1f9ae0e3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.680334 Sep 23 01:31:03.188544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 74/143] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:02 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:04.224452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:04.225070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:04.231894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:04.232174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:04.232595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:04.233838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:04.234291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:04.234900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:04.472480 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:04.485911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ceca7b8e-e325-4bac-8c44-b1486f1c77d7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.265251 Sep 23 01:31:04.486688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 70/144] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:04 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:05.265944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:05.277373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:05.286605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:05.286605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:05.292227 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] Creating event network-changed:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:31:05.300205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-f743083c-f69c-4297-bf29-299ad5cf7e72 req-a5c7772c-e0a4-48ec-93b5-2d1f2f0a8f1b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038435 Sep 23 01:31:05.302246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 75/145] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:31:05.521614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:05.522499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:05.531777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:05.532445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:05.533027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:05.533983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:05.534942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:05.535701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:05.854205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:05.893541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7b57ff88-36f1-480f-8303-9d02795d3512 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.370167 Sep 23 01:31:05.900923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 71/146] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:05 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:06.949052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:06.950521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:06.974893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:06.975383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:06.975847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:06.976563 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:06.981453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:06.981933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:07.228454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:07.241794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f88dc03a-4095-499f-900f-64d0e9d888c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.307653 Sep 23 01:31:07.242860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 76/147] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:06 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:08.270327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:08.271896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:08.278999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:08.280564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:08.281227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:08.282172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:08.282903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:08.283625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:08.312304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:08.498086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:08.505942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-99801fe1-a32d-4463-af44-5ae399129a7d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.240160 Sep 23 01:31:08.506900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 72/148] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:08 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:09.534740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:09.537863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:09.560240 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:09.563088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:09.564011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:09.565566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:09.569466 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:09.572350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:09.770887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:09.779092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-30338de9-c3c4-4c7f-8168-99cd7b0bcf85 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.251435 Sep 23 01:31:09.782238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 77/149] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:09 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:10.812459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:10.812459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:10.821936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:10.822440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:10.822910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:10.823746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:10.824440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:10.825308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:11.001235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:11.010256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5caadc30-bae0-411a-85de-0a208d6498c9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.206889 Sep 23 01:31:11.010845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 73/150] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:10 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:12.040195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:12.042417 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:12.053749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:12.055107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:12.071515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:12.073061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:12.073886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:12.074596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:12.351343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:12.367327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e0f61614-d604-49cf-8e72-b5d7d8297ef4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.335616 Sep 23 01:31:12.368002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 78/151] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:12 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:13.410831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:13.411730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:13.426749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:13.427327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:13.432031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:13.436482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:13.436482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:13.440695 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:13.447900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:13.448964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:13.472005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:13.473354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:13.474075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:13.480037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:13.481064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:13.481937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:13.602844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:31:13.785846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:13.803913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4de7e79b-8ae8-4218-a3af-6873ebf3af8d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.396797 Sep 23 01:31:13.805027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 74/152] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:13 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:14.115832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a02c5404-c5e7-4308-aeed-791ea9b344b8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 204 len: 0 microversion: 2.1 time: 0.671379 Sep 23 01:31:14.116501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 79/153] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:31:13 2022] DELETE /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 01:31:14.126008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:14.126772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:14.133884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:14.134735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:14.135276 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:14.136214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:14.136807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:14.137282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:14.316974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:14.329190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-69e7caf8-9258-439a-97ee-b2b86059349d tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1551 microversion: 2.1 time: 0.208009 Sep 23 01:31:14.329777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 75/154] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:14 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1551 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:14.849110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:14.854840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:14.866231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:14.867904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:14.867904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:14.868799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:14.869742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:14.870714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:15.161707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:15.177790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3836edde-60e0-4279-81af-c84b24ddeda5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.335154 Sep 23 01:31:15.179601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 80/155] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:14 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:15.355930 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:15.356999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:15.369848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:15.371098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:15.372226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:15.373471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:15.374298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:15.375045 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:15.657887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:15.668791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-32da2e59-30e2-444b-87ed-ac201a8b6b22 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1551 microversion: 2.1 time: 0.317878 Sep 23 01:31:15.669672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 76/156] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:15 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1551 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:16.212496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:16.216476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:16.232120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:16.233024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:16.234221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:16.235906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:16.238041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:16.239484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:16.484999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:16.494707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-07657af0-62a4-407a-b808-fed364b4dabe tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.294689 Sep 23 01:31:16.495291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 81/157] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:16 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:16.695055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:16.696642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:16.706021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:16.706998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:16.707749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:16.708849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:16.709666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:16.710252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:17.304393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:17.326206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3c36864c-fcb7-4fb0-a9ad-4e39a99861d8 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1551 microversion: 2.1 time: 0.635338 Sep 23 01:31:17.328570 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 77/158] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:16 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1551 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:17.521359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:17.521988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:17.530784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:17.531364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:17.532114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:17.532870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:17.533431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:17.534034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:17.554741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:17.888565 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:17.904584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3fac4a90-5dc7-4fda-a54a-eb0e92efb309 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.386613 Sep 23 01:31:17.922810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 82/159] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:17 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:18.111956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2166a98-2e71-4367-aa3a-9064cb15ae82", "name": "network-vif-deleted", "tag": "2731a03e-93f1-42a0-9954-08f752288652"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:18.122674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:18.139895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:18.141647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:18.161696 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] Creating event network-vif-deleted:2731a03e-93f1-42a0-9954-08f752288652 for instance d2166a98-2e71-4367-aa3a-9064cb15ae82 on hv-cinder-84914 Sep 23 01:31:18.174965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-2cab11b7-3bd9-4baf-bd92-4bb3e1253c6e req-17537448-f0c5-4b33-b0b7-fed5f7e3fd89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063236 Sep 23 01:31:18.174965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 78/160] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:18.372740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:18.373849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:18.394110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:18.394955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:18.396316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:18.397929 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:18.399010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:18.400012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:18.487471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:18.502057 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f1833c90-791a-463a-aa25-90992d58ac3b tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1345 microversion: 2.1 time: 0.136493 Sep 23 01:31:18.502690 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 83/161] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:18 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1345 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:18.954869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:18.958016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:18.970423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:18.971774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:18.972485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:18.973692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:18.974381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:18.974965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:19.191998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:19.205645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6203516a-419e-4dc5-b7d3-2b3b77781ddd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.262090 Sep 23 01:31:19.206588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 79/162] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:18 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:19.528472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:19.531801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:19.537275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:19.537958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:19.538401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:19.539112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:19.539723 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:19.540089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:19.595606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:19.596167 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:19.597440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:19.597989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lazy-loading 'fault' on Instance uuid d2166a98-2e71-4367-aa3a-9064cb15ae82 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:31:19.662901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:19.675423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-be164536-74f0-41cf-9ec5-9e7d13bee989 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1350 microversion: 2.1 time: 0.151131 Sep 23 01:31:19.676056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 84/163] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:19 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1350 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:20.230796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:20.232151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:20.242079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:20.245024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:20.245474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:20.246206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:20.246662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:20.247080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:20.455204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:20.469331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-55177377-8436-4a8b-a81e-55a2e8ff9b1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.242375 Sep 23 01:31:20.469927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 80/164] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:20 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:20.719851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:20.721202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:20.740361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:20.741947 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:20.745026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:20.750499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:20.751287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:20.754879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:20.866793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:20.867804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:20.868493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:20.869186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lazy-loading 'fault' on Instance uuid d2166a98-2e71-4367-aa3a-9064cb15ae82 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:31:20.927859 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f628503bfd24338b4a351d05a18f126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a90db67f8f74446b8cbd913a2a17c0b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:20.941811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-306364a6-42a0-49cf-b4be-fd2104d2bc61 tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 200 len: 1350 microversion: 2.1 time: 0.229109 Sep 23 01:31:20.945180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 85/165] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:20 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 1350 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:21.497555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:21.500628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:21.518129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:21.518129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:21.518129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:21.518129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:21.518569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:21.518569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:21.698386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:21.707173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-013d3493-a7aa-4f7b-9121-c4c5ddf1ffa4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.217978 Sep 23 01:31:21.707798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 81/166] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:21 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:21.966660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:21.967272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:21.974866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:21.975358 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:21.975827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:21.976539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:21.977224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:21.977703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:21.995293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] HTTP exception thrown: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Request method failure captured: Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 HTTP/1.1 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwPgxCR_JaV9W3j079A5bAQgR0LS7lLb9ksNJdGIGmlLQ3sl4IH5lbKt30qnv9AuJh3JB85MH3SBuMEvms1dHxkWMEq4KHVqN9FtV6wodJehS5lUxb9atIR5qSS6hFJ1FCz4XpTQr7YPgng7jp0RNDLgzJS7hNyeZDfdBd5_dmZJIo Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:31:22.010359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a90db67f8f74446b8cbd913a2a17c0b1", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1f628503bfd24338b4a351d05a18f126 Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.011753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'd2166a98-2e71-4367-aa3a-9064cb15ae82'} Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:31:22.012442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.013573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.015271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Returning 404 to user: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:31:22.015271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-37576d11-e06b-4587-8240-dd0e85c2e47a tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 404 len: 111 microversion: 2.1 time: 0.049609 Sep 23 01:31:22.015271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 86/167] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:21 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:31:22.212483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:22.217095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:22.227483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:22.228085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:22.228801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:22.229708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:22.230269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:22.230699 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:22.247049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] HTTP exception thrown: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Request method failure captured: Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82/os-volume_attachments HTTP/1.1 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwPgxCR_JaV9W3j079A5bAQgR0LS7lLb9ksNJdGIGmlLQ3sl4IH5lbKt30qnv9AuJh3JB85MH3SBuMEvms1dHxkWMEq4KHVqN9FtV6wodJehS5lUxb9atIR5qSS6hFJ1FCz4XpTQr7YPgng7jp0RNDLgzJS7hNyeZDfdBd5_dmZJIo Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:31:22.268260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a90db67f8f74446b8cbd913a2a17c0b1", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1f628503bfd24338b4a351d05a18f126 Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.271135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'server_id': 'd2166a98-2e71-4367-aa3a-9064cb15ae82'} Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:31:22.272621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:22.274766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:22.279635 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Returning 404 to user: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:31:22.281572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a7b43fb9-e315-476a-a206-e0a33476d36c tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.076727 Sep 23 01:31:22.290277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 82/168] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:31:22 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:31:22.741265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:22.744104 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:22.754028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:22.754924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:22.755344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:22.756111 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:22.756775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:22.757409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:23.072780 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:23.093906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f1b0e7cc-4792-44aa-893a-9db05148b1e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.362950 Sep 23 01:31:23.101559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 87/169] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:22 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:23.961146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:23.962843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:23.977048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:23.978067 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:23.978985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:23.980722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:23.983412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:23.985259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:24.042499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] HTTP exception thrown: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Request method failure captured: Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 HTTP/1.1 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwPgxCR_JaV9W3j079A5bAQgR0LS7lLb9ksNJdGIGmlLQ3sl4IH5lbKt30qnv9AuJh3JB85MH3SBuMEvms1dHxkWMEq4KHVqN9FtV6wodJehS5lUxb9atIR5qSS6hFJ1FCz4XpTQr7YPgng7jp0RNDLgzJS7hNyeZDfdBd5_dmZJIo Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:31:24.048218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a90db67f8f74446b8cbd913a2a17c0b1", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1f628503bfd24338b4a351d05a18f126 Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.049538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'd2166a98-2e71-4367-aa3a-9064cb15ae82'} Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:31:24.050406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.051456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.054901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Returning 404 to user: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:31:24.054901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1c85e185-d3cc-483a-9ad7-74f5f5589bda tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 404 len: 111 microversion: 2.1 time: 0.098707 Sep 23 01:31:24.054901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 83/170] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:31:23 2022] DELETE /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:31:24.065615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:24.067712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] [instance: d2166a98-2e71-4367-aa3a-9064cb15ae82] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:24.080446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:24.081385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:24.082179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:24.083833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:24.085044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:24.086195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:24.115752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] HTTP exception thrown: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Request method failure captured: Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 HTTP/1.1 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwPgxCR_JaV9W3j079A5bAQgR0LS7lLb9ksNJdGIGmlLQ3sl4IH5lbKt30qnv9AuJh3JB85MH3SBuMEvms1dHxkWMEq4KHVqN9FtV6wodJehS5lUxb9atIR5qSS6hFJ1FCz4XpTQr7YPgng7jp0RNDLgzJS7hNyeZDfdBd5_dmZJIo Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:31:24.118875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a90db67f8f74446b8cbd913a2a17c0b1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a90db67f8f74446b8cbd913a2a17c0b1", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a90db67f8f74446b8cbd913a2a17c0b1 Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-DeleteServersTestJSON-1272327012 Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1f628503bfd24338b4a351d05a18f126 Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-DeleteServersTestJSON-1272327012-project Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.120402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'd2166a98-2e71-4367-aa3a-9064cb15ae82'} Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:31:24.121196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. Sep 23 01:31:24.122735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:31:24.124062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] Returning 404 to user: Instance d2166a98-2e71-4367-aa3a-9064cb15ae82 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:31:24.124062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7e48b713-2c09-4dfe-97a8-d4a6abce59fc tempest-DeleteServersTestJSON-1272327012 tempest-DeleteServersTestJSON-1272327012-project] 10.222.0.64 "GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82" status: 404 len: 111 microversion: 2.1 time: 0.062659 Sep 23 01:31:24.124062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 88/171] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:24 2022] GET /compute/v2.1/servers/d2166a98-2e71-4367-aa3a-9064cb15ae82 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:31:24.144583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:24.145791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:24.177162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:24.178174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:24.179301 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:24.180965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:24.182144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:24.183237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:24.490547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:24.515422 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8e657892-6659-42db-962e-af2827136f12 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.377701 Sep 23 01:31:24.516674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 84/172] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:24 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:25.564781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:25.566610 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:25.570364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:25.588347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:25.589695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:25.590632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:25.592975 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:25.594470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:25.595513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:26.142335 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:26.187281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-aaab9ae2-d8a9-4034-adbf-9d80d5ca19af tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.627292 Sep 23 01:31:26.188493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 89/173] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:25 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:27.233459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:27.240722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:27.264629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:27.265529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:27.266843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:27.268220 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:27.269090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:27.269843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:27.515208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:27.536728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b2e12abd-45ed-46bc-bfdd-c94595ddc0e9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.312425 Sep 23 01:31:27.539325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 85/174] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:27 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:28.578213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:28.579206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:28.591830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:28.592248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:28.592796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:28.594025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:28.595390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:28.596381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:29.068712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:29.080931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f43d96f2-c9d6-4894-a0e4-da64749cdd65 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.508556 Sep 23 01:31:29.081931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 90/175] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:28 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:30.120570 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:30.121434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:30.124543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=48 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:30.134144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:30.134882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:30.135622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:30.136852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:30.137836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:30.138523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:30.388278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:30.401781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-da1a88c0-f118-403c-8c1f-1c978e26bb64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.286749 Sep 23 01:31:30.403017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 86/176] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:30 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:31.434807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:31.436590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:31.450620 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:31.452601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:31.453488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:31.454708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:31.455426 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:31.456150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:31.926355 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:31.940982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1d95f951-4f6f-4365-8da4-6e0249d0bec9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.515348 Sep 23 01:31:31.946610 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 91/177] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:31 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:32.983017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:32.983822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:32.993342 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:32.994200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:32.994877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:32.995908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:32.996637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:32.997237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:33.171360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:33.211799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0b604fc3-af71-4da9-9517-0ba5b28d5472 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.235507 Sep 23 01:31:33.224189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 87/178] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:32 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:34.267007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:34.268760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:34.282558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:34.288363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:34.288363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:34.288363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:34.288363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:34.289002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:34.652842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:34.661867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4ab18911-d492-4694-a9eb-15a2dc9bbafc tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.412398 Sep 23 01:31:34.662459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 92/179] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:34 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:35.707872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:35.709110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:35.721090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:35.722547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:35.722993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:35.725227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:35.727071 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:35.728201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:35.986880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:36.000357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4d1fd0bc-0cca-47b2-b77e-4aac3433d140 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.299401 Sep 23 01:31:36.007829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 88/180] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:35 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:37.031727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:37.032705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:37.040052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:37.040573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:37.041031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:37.041962 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:37.042439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:37.042869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:37.223662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:37.238503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bc418600-5a14-4863-a2f6-3f1f251d25d5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1523 microversion: 2.1 time: 0.210973 Sep 23 01:31:37.239358 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 93/181] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:37 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:38.271979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:38.282659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:38.287990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:38.288832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:38.289458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:38.290176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:38.290622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:38.291294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:38.480915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:38.492781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8017e757-0938-4ce0-970c-73b416dbdf5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1503 microversion: 2.1 time: 0.231910 Sep 23 01:31:38.508846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 89/182] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:38 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1503 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:38.518991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:38.519801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:38.526188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:38.526726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:38.527150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:38.528073 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:38.528684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:38.529705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:38.698936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:38.710811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e58ac57c-1165-40b5-81a9-680d0c390b28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1516 microversion: 2.1 time: 0.195653 Sep 23 01:31:38.712735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 94/183] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:38 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:41.490557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:41.493002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:41.512675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:41.512675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:41.512675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:41.512675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:41.513272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:41.513272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:41.550922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'flavor' on Instance uuid a75f4424-87db-4f88-a745-e8071a1a3404 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:31:41.588861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:41.998545 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-044840f5-a6d7-4505-9744-0770497ee684 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/action" status: 200 len: 32 microversion: 2.1 time: 0.510932 Sep 23 01:31:42.001468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 90/184] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:31:41 2022] POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/action => generated 32 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:31:42.019519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:42.022320 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:42.042589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:42.044406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:42.046854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:42.047752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:42.048981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:42.049681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:42.276654 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:42.293493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-aa59b13a-1319-4c18-beb5-4d1c11c9c874 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.280942 Sep 23 01:31:42.296724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 95/185] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:42 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:43.335233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:43.336397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:43.351049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:43.351680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:43.353146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:43.355059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:43.355175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:43.355767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:43.642774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:43.652236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-089492cd-7335-417a-985c-c526fdc61142 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.322303 Sep 23 01:31:43.653600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 91/186] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:43 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:44.677124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:44.677842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:44.686858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:44.688022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:44.688611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:44.689790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:44.690331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:44.690832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:44.909837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:44.934195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-16159a6f-3acd-4a3b-afbc-c022eb6a10f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.261406 Sep 23 01:31:44.936032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 96/187] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:44 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:45.974320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:45.975614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:45.982052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:45.983303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:45.983969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:45.984656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:45.985294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:45.985739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:46.281132 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:46.292969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-68d26762-3c37-4040-9217-43c66ceab9ef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.322945 Sep 23 01:31:46.294054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 92/188] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:45 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:47.305741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1384597956", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "networks": [{"uuid": "9bf674af-206f-436e-bb8c-2e0cce6fc1f2"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:47.323925 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:47.324663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:47.334496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:47.334755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:47.335378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:47.336128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:47.336595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:47.337020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:47.393733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] validate_networks() for [('9bf674af-206f-436e-bb8c-2e0cce6fc1f2', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:31:47.508618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:47.523971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bb8477dd-0378-4c7b-af92-d5b4f6cb3ee2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.204528 Sep 23 01:31:47.525057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:47 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:47.895990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:31:47.896410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:31:47.896894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:31:47.897449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:31:47.898465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:31:47.908777 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:47.908983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:47.909475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:47.910217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:47.910660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:47.911078 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:47.931817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Getting quotas for project 3816d889342e400383f7e5e6f4ebbe04. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:31:47.937311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Getting quotas for user 1658e3b405ea41939ff42b6bb36d87f7 and project 3816d889342e400383f7e5e6f4ebbe04. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:31:47.952786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:31:47.955144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:31:48.135920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bef8c545-d3ee-4931-8ae7-37ca54fa9ca2 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830903 Sep 23 01:31:48.135920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 97/190] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:31:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:31:48.155155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2245c401-0ec6-422f-884a-927c06e53afc tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:48.156126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2245c401-0ec6-422f-884a-927c06e53afc tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:48.240606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2245c401-0ec6-422f-884a-927c06e53afc tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:48.251476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2245c401-0ec6-422f-884a-927c06e53afc tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1214 microversion: 2.1 time: 0.102165 Sep 23 01:31:48.254069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 94/191] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:48 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1214 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:48.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:48.549708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:48.556504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:48.557626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:48.558071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:48.558754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:48.559201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:48.559646 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:48.802820 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:48.812730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0bad62ae-816a-431a-91b7-65ab67490e51 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.267555 Sep 23 01:31:48.813949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 98/192] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:48 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:49.042513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:49.043342 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:49.050702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:49.051193 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:49.051664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:49.052373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:49.052828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:49.053278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:49.084926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c5842517-860b-4e28-8f04-089d1c3694dc tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/ips" status: 200 len: 146 microversion: 2.1 time: 0.046669 Sep 23 01:31:49.085789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 95/193] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:31:49 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:49.284990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f7a9f44c-c739-4fc3-aabd-b735405cb14e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:49.288568 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f7a9f44c-c739-4fc3-aabd-b735405cb14e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:49.402092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f7a9f44c-c739-4fc3-aabd-b735405cb14e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:49.421996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f7a9f44c-c739-4fc3-aabd-b735405cb14e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1214 microversion: 2.1 time: 0.147597 Sep 23 01:31:49.423633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 99/194] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:49 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1214 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:49.854575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:49.855715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:49.864814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:49.865681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:49.871586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:49.871586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:49.871586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:49.871586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:50.045730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:50.058637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-674ee270-effc-4885-837b-11c96fccd129 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.209754 Sep 23 01:31:50.059304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 96/195] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:49 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:50.461133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:50.461818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:50.470683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:50.471218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:50.471754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:50.472502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:50.472994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:50.473414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:50.546722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:50.555584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-23405ef1-fc09-4a99-931e-e3a56bc1f59e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1210 microversion: 2.1 time: 0.101802 Sep 23 01:31:50.557082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 100/196] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:50 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:50.610737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:50.611643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:50.624087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:50.624936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:50.625711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:50.627010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:50.628213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:50.629264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:50.676999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-51752e98-fe4d-4992-b486-21adf4bda482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/ips" status: 200 len: 152 microversion: 2.20 time: 0.074040 Sep 23 01:31:50.679386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 97/197] 10.222.0.64 () {60 vars in 1289 bytes} [Fri Sep 23 01:31:50 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/ips => generated 152 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:31:51.101758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:51.102783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:51.126191 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:51.127040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:51.128170 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:51.129241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:51.130132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:51.132968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:51.165654 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:51.495172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:51.510448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-551cb853-d383-4c92-8e22-98af56aa0387 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.414176 Sep 23 01:31:51.511472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 101/198] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:51 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:51.585496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:51.586128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:51.595985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:51.596773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:51.597677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:51.599026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:51.599884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:51.600652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:52.041988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:52.051348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-734a96a9-7d6f-48ad-b8b5-f7195aeb12c4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1266 microversion: 2.1 time: 0.469615 Sep 23 01:31:52.067446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 98/199] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:51 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1266 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:52.539541 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:52.545986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:52.576955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:52.592772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:52.596155 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:52.599837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:52.600828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:52.606148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:52.926916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:52.936464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ae1e750a-c8f1-4e58-bd37-ee344614dd73 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.404415 Sep 23 01:31:52.937390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 102/200] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:52 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:53.078099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:53.078926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:53.109353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:53.109353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:53.109353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:53.109353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:53.110055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:53.110055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:53.202774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:53.212145 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2fd294eb-f747-447c-900f-2020aac75265 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1272 microversion: 2.1 time: 0.141050 Sep 23 01:31:53.212852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 99/201] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:53 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1272 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:53.620513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e525899-4342-4446-ac9a-37b0f9e92315"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:53.624709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:53.636040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:53.636560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:53.637185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:53.637990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:53.639021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:53.639490 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:53.994838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:54.007133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:54.024923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.025473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.026106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.026832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.027309 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.027869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.290727 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:54.304153 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-69823325-256a-43f3-903f-c60a573b0992 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.341582 Sep 23 01:31:54.305073 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 100/202] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:53 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:54.316441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:54.317336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:54.324072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.324777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.325217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.326761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.327215 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.327824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.522476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:54.531610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1ed8bde5-e845-417b-8c18-b40aa93a0d9b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.225569 Sep 23 01:31:54.532192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 101/203] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:54 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:54.696771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:54.697049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:54.703844 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.706655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.706655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.706655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:54.706655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:54.707192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:54.743113 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'flavor' on Instance uuid dd3312b8-1d33-4b15-9ffd-270013a3b14d {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:31:54.999430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4cd399d5-0bf8-450d-bb9d-71aab34985b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.386383 Sep 23 01:31:55.000756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 103/204] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:31:53 2022] POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments => generated 194 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:55.337883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:55.338712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:55.353119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.353871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.355314 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.359028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.359528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.361508 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.569649 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4880ca3e-25b7-4355-abc9-fa8fcdc12b1a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/action" status: 202 len: 0 microversion: 2.20 time: 0.877698 Sep 23 01:31:55.570481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 102/205] 10.222.0.64 () {62 vars in 1319 bytes} [Fri Sep 23 01:31:54 2022] POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/action => generated 0 bytes in 879 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 23 01:31:55.585102 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:55.597705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:55.613736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.615157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.615969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.617555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.626482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.626482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.704609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:55.736506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a2a61a37-66dc-4323-916c-b3d582742945 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.402873 Sep 23 01:31:55.737606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 104/206] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:55 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:55.751838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:55.753308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:55.762847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.767949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.767949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.767949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:55.767949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:55.768331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:55.989465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:56.023704 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3df34b14-0b2d-4388-9631-36c5558ec39d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.449736 Sep 23 01:31:56.040179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 103/207] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:55 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:56.074738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:56.091232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:56.101455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:56.105810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff5ed0ff-7a90-44cc-b660-a4a8554cd526 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.366449 Sep 23 01:31:56.108917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 105/208] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:31:55 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:31:56.251787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8e8957e-701e-458d-85dc-f85fadd5cd30", "tag": "50f6d2ef-4fa7-4a7a-83e6-6a047944f173"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:31:56.289510 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:56.294072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:56.295482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:56.321534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] Creating event network-changed:50f6d2ef-4fa7-4a7a-83e6-6a047944f173 for instance b8e8957e-701e-458d-85dc-f85fadd5cd30 on hv-cinder-84914 Sep 23 01:31:56.331755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-06bef4e4-9ef6-4719-8910-fb405922e486 req-87804786-6617-42ba-b8ab-49d4252ed75a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087099 Sep 23 01:31:56.333669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 104/209] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:31:56.764724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:56.765460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:56.774719 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:56.775266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:56.776145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:56.777159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:56.778069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:56.778806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:57.067116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:57.070504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:57.093293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:57.096030 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:57.098014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:57.099361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:57.100235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:57.100987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:57.152381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:57.174454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-086ea52a-9b05-4104-9035-e07e23994c63 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.412568 Sep 23 01:31:57.174454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 106/210] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:56 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:57.177839 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:57.178649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:57.185169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:57.185657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:57.186303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:57.187020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:57.187591 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:57.188171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:57.413449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:57.428912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-70dad700-1ac5-4501-84ff-6d1af5d9ff5e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.369668 Sep 23 01:31:57.444321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 105/211] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:57 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:57.870912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:57.878921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:57.881130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:57.885031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a73681fa-7cf8-4105-94cf-128e345a9944 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.709493 Sep 23 01:31:57.887022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 107/212] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:31:57 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:31:58.205244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:58.206243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:58.217281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.218689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.219932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:58.221357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.225988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.225988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:58.235000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:58.260945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:58.473611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:58.475642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:58.481453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:58.489963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.491260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.492451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:58.493781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.494592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.495841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:58.534613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:58.543233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-288df12c-4198-46c4-9c6e-b7236cff1dd1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.346138 Sep 23 01:31:58.555589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 106/213] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:58 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:31:58.761960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:58.778172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8f7f3b48-75fe-4e72-9a8f-63ee03fd2ffe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.309434 Sep 23 01:31:58.779241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 108/214] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:58 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:58.938267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:58.939714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:58.967950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.969037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.970136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:58.971514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:58.972313 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:58.973007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:59.163753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:59.179846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:59.183194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:59.185516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fba08c55-6058-40a3-bace-9c949eaf080a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.256813 Sep 23 01:31:59.186451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 107/215] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:31:58 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:31:59.593391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:59.594396 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:59.597924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=8 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:59.598838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:31:59.604904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:59.605573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:59.606111 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:59.607673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:59.608261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:59.608680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:59.778527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:31:59.787995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-59921875-e6b1-4c89-80ee-521f948874bb tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.202126 Sep 23 01:31:59.788588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 109/216] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:59 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:31:59.820319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:31:59.820987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:31:59.828602 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:59.829107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:59.829556 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:31:59.832777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:31:59.833324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:31:59.833769 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:00.070701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:00.088901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-57bd36f4-fad5-4dde-b4a8-2f1d7015cc29 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.272630 Sep 23 01:32:00.100734 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 108/217] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:31:59 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:00.217848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:00.218576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:00.231233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:00.232308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:00.233028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:00.234528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:00.235419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:00.236197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:00.501675 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:00.506184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:00.507752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:00.509092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-833ddbda-8d55-46a6-96b8-b91658027a77 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.298663 Sep 23 01:32:00.509725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 110/218] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:00 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:00.814382 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:00.816480 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:00.830420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:00.831108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:00.831432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:00.832217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:00.833006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:00.833090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:01.109692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:01.122155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c7646c7e-997c-4c2a-980a-feebda80dfbd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.313007 Sep 23 01:32:01.124662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 109/219] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:00 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:01.130626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:01.132117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:01.151727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:01.151727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:01.151727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:01.151727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:01.152118 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:01.152769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:01.414785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:01.434360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-17689060", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "networks": [{"uuid": "2e07beaf-fde3-41c4-b32f-8b8bdfbb8f05"}]}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:01.459524 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-52f7f610-32d4-4d3f-827a-e00b6791629f tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.339476 Sep 23 01:32:01.461309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 111/220] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:01 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:01.537292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:01.538391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:01.557181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:01.558049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:01.558810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:01.559650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.network.neutron [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] validate_networks() for [('2e07beaf-fde3-41c4-b32f-8b8bdfbb8f05', None, None, None, None, None)] {{(pid=121763) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:32:01.560651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:01.561503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:01.562265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:01.805494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:01.828269 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:01.832679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:01.834888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-25add058-4270-419d-9d08-2077003f56b8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.302699 Sep 23 01:32:01.836168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 112/221] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:01 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:02.078369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Flavor limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:32:02.078901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Image limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:32:02.079241 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Flavor pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:32:02.079765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Image pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:32:02.080182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:32:02.090473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.090955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.091377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.092388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.092856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.093330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.112344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Getting quotas for project 95935852764e413c8bbd23c16ddf13a5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:32:02.119710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Getting quotas for user c8982a7c52314c5a82d80a03d9a833d6 and project 95935852764e413c8bbd23c16ddf13a5. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:32:02.129487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Going to run 1 instances... {{(pid=121763) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:32:02.131843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:32:02.157490 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:02.158323 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:02.165386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.165966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.166405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.167252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.167750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.168176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.332405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2522cd63-aca7-4533-87b4-9f57e2bfd92c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913449 Sep 23 01:32:02.339452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 110/222] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:32:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:32:02.363053 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-94aefa31-3d82-4756-a7b1-0199126d3872 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:02.367304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-94aefa31-3d82-4756-a7b1-0199126d3872 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:02.370980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:02.383244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6b7ddb10-9a27-455d-a615-5fa545c2cfe4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.233662 Sep 23 01:32:02.384239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 113/223] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:02 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:02.443739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-94aefa31-3d82-4756-a7b1-0199126d3872 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:02.452798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-94aefa31-3d82-4756-a7b1-0199126d3872 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1217 microversion: 2.1 time: 0.098844 Sep 23 01:32:02.453652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 111/224] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:02 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:02.529440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:02.530965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:02.548517 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.549402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.552561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.555722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.558093 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.832934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:02.839622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7e125855-6937-4e3d-a92c-fdaaeb38fb5b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.331930 Sep 23 01:32:02.840186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 114/225] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:02 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:02.869000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:02.871094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:02.887618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.889037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.889940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:02.891148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:02.892262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:02.894094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.191591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:03.204384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:03.206385 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:03.208425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-16ba4759-a4ea-458e-89e1-80b6a9c06ca4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.348262 Sep 23 01:32:03.219592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 112/226] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:02 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:03.364211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e8957e-701e-458d-85dc-f85fadd5cd30", "name": "network-vif-plugged", "status": "completed", "tag": "50f6d2ef-4fa7-4a7a-83e6-6a047944f173"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:03.386910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.387442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.388265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.406184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] Creating event network-vif-plugged:50f6d2ef-4fa7-4a7a-83e6-6a047944f173 for instance b8e8957e-701e-458d-85dc-f85fadd5cd30 on hv-cinder-84914 Sep 23 01:32:03.420748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:03.421578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:03.426299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:03.432119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e5526503-8095-4433-8382-ddb0cec8144f req-4fbda52c-ab3a-4c24-a9ea-f7cb7f41c03a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075668 Sep 23 01:32:03.434593 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 115/227] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:03.449559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.450684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.453950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.457483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.458646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.461213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.479246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-403dfe37-a3ec-4c1a-88d2-88e7643d954b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:03.480028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-403dfe37-a3ec-4c1a-88d2-88e7643d954b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:03.608035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-403dfe37-a3ec-4c1a-88d2-88e7643d954b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:03.619341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-403dfe37-a3ec-4c1a-88d2-88e7643d954b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1217 microversion: 2.1 time: 0.146510 Sep 23 01:32:03.619968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 116/228] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:03 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1217 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:03.732977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:03.745589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c27b260e-dba2-4917-9b1b-e5719e830d64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1502 microversion: 2.1 time: 0.334692 Sep 23 01:32:03.746830 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 113/229] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:03 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1502 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:03.777649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59cdaf40-a87c-4b43-b368-ebb28e674f01"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:03.783703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:03.796461 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.796911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.797738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.798475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.798939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.799422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.843926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] HTTP exception thrown: Cannot 'attach_volume' instance a75f4424-87db-4f88-a745-e8071a1a3404 while it is in vm_state rescued Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Request method failure captured: Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/os-volume_attachments HTTP/1.1 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 74 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYBYfcTzkvR_x_fgIoxQGBOVYevi2Zp0PQLNN5Adxub1momkDvhIUnyFD_xKYjC8o2mSrGKkiNqU7YlOSJNrmN9iRcrS5T9B-cW3MfIfRBifWzhuUFzwbGBgz-iR7DgoI3fh3hU9AO84ILe7Fwq53zwDcFXPnC_TPq0HyQXNH8MCc Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:32:03.858767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b8939e407ff4bdc81191af7f0593cd5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: da9978cab3fb4bdda39a2e4718ee2cc7 Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {"volumeAttachment": {"volumeId": "59cdaf40-a87c-4b43-b368-ebb28e674f01"}} Sep 23 01:32:03.860145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Cannot 'attach_volume' instance a75f4424-87db-4f88-a745-e8071a1a3404 while it is in vm_state rescued Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'server_id': 'a75f4424-87db-4f88-a745-e8071a1a3404', 'body': {'volumeAttachment': {'volumeId': '59cdaf40-a87c-4b43-b368-ebb28e674f01'}}} Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a75f4424-87db-4f88-a745-e8071a1a3404 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:32:03.860921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a75f4424-87db-4f88-a745-e8071a1a3404 while it is in vm_state rescued Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:03.862146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a75f4424-87db-4f88-a745-e8071a1a3404 while it is in vm_state rescued Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Returning 409 to user: Cannot 'attach_volume' instance a75f4424-87db-4f88-a745-e8071a1a3404 while it is in vm_state rescued {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4f1a37dd-9c6d-45df-b5f2-58e1f30c3316 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090107 Sep 23 01:32:03.864796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 117/230] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:32:03 2022] POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/os-volume_attachments => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 01:32:03.880440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:03.881035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:03.887321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.887614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:03.888182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:03.888490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.889105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.890223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.891483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.892122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.900458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.901257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.901982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.903166 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:03.904386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:03.905096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:03.988055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:04.195711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.229250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-14ae859c-e06a-4caf-b4fe-30f58c1f3ae1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.356868 Sep 23 01:32:04.243284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 114/231] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:03 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:04.259981 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:04.260601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:04.271500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.272039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.272490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.273277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.273647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.274141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.291068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0326266d-25cc-4cdb-b97c-4a19b1b78951 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/action" status: 202 len: 0 microversion: 2.1 time: 0.401033 Sep 23 01:32:04.297971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 118/232] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:32:03 2022] POST /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:32:04.319883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:04.321390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:04.335660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.336912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.338124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.340455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.342011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.343042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.537166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.550470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.575886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.575886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6df338d3-cb8b-44a6-9687-b632a58b6ca6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.320988 Sep 23 01:32:04.575886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 115/233] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:04 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:04.575886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:04.576840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.577714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.578579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.598663 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.613230 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-396d4705-7030-4e0d-888b-e9be0a4d0372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1510 microversion: 2.1 time: 0.308045 Sep 23 01:32:04.614641 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 119/234] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:04 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:04.649619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:04.650346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:04.658746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.659451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.660420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.661464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:04.662097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:04.662837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:04.694315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Going to try to stop instance {{(pid=121763) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 01:32:04.920495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:04.932511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3fb881af-5c16-47f2-91d0-222dccbc8696 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1221 microversion: 2.1 time: 0.285180 Sep 23 01:32:04.932511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 120/235] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:04 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1221 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:05.082856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-167a7a33-53f5-4ce3-a141-1d4ff63a8ff0 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action" status: 202 len: 0 microversion: 2.1 time: 0.526392 Sep 23 01:32:05.084548 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 116/236] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:32:04 2022] POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:32:05.104096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:05.111694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:05.116278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.116816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.117323 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.118401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.118770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.119192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.285803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:05.286776 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:05.311430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.312054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.312708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.313416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.313955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.314434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.378046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:05.387765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1c699fdf-1093-41a4-841c-ee71c6e0fbac tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.294969 Sep 23 01:32:05.406617 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 121/237] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:05 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:05.583618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:05.584225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:05.594968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.596333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.596791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.597535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.598017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.598438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.788328 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:05.799428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-611bffc9-29ae-48b6-9e42-d3a2ab320f0c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1314 microversion: 2.1 time: 0.530180 Sep 23 01:32:05.800643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:05 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:05.805582 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:05.806576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:05.813638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.815471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.815471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.816223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.817257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.817888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.845503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:05.855994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:05.857579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:05.859301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4a4d5934-ae74-47f9-be4e-d4cedf81769a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.279703 Sep 23 01:32:05.860507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 122/239] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:05 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:05.958317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:05.958948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:05.967849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.969980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.969980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.970925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:05.972229 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:05.972659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:05.996692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:06.013289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f767164f-a811-4bd0-8f6c-aa7b19772f3c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1510 microversion: 2.1 time: 0.211298 Sep 23 01:32:06.026830 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 118/240] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:05 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1510 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:06.091676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:06.096738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e5f29b6e-4bd4-426b-8fc8-5e5a5c86f08a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1213 microversion: 2.1 time: 0.144345 Sep 23 01:32:06.097793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 123/241] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:05 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1213 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:06.420571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:06.421288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:06.433120 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.433624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.434129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:06.434776 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.435301 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.435724 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:06.646102 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:06.656051 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-41088282-859a-445c-943d-629a464f23af tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.239578 Sep 23 01:32:06.656687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 119/242] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:06 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:06.826957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:06.827925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:06.852169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.852914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.853612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:06.854767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.855266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.855831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:06.888926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:06.889812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:06.906335 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.906508 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.906989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:06.910759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:06.911695 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:06.915123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.152680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.169182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c4ca94e9-9899-4eff-a6cb-2c0402118cd3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1498 microversion: 2.1 time: 0.339846 Sep 23 01:32:07.184510 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 124/243] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:06 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1498 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:07.198092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:07.198092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:07.203056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.203579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.204574 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.205316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.205779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.206192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.242586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.252884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.254606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.256042 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cb28d577-af58-4214-b1f9-5448260c4086 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.373410 Sep 23 01:32:07.276811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 120/244] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:06 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:07.282368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:07.283172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:07.300159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.300159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.300159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.300159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.300555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.300555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.408429 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.428867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d22b748d-5eaf-4b51-beca-d0fafbdf2b29 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1269 microversion: 2.1 time: 0.149375 Sep 23 01:32:07.430569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 121/245] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:07 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:07.465390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.473284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f1e301e8-d374-44cf-b07c-59af5d934df6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1510 microversion: 2.1 time: 0.286249 Sep 23 01:32:07.473906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 125/246] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:07 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:07.686126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:07.686973 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:07.694526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.695118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.696099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.696373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:07.696827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:07.697248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:07.858700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:07.868506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2e44c904-5f66-4170-a649-4b674119ab4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.189303 Sep 23 01:32:07.869090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 122/247] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:07 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:08.285882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:08.286505 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:08.293491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.293981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.295002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.295740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.296204 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.296629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.456355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:08.458405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:08.481592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.482836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.483764 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.484772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.485403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.485999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.486525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:08.511479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:08.514893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:08.516401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:08.517653 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c6519ffc-6e2c-49c6-b741-f768039c1db6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.236521 Sep 23 01:32:08.518533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 126/248] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:08 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:08.523940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:08.524785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:08.532787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.533583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.534186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.535070 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.535731 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.536345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.582895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:08.594231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1ba15366-64a2-4f4a-aab5-85030049bfe2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1269 microversion: 2.1 time: 0.141986 Sep 23 01:32:08.594924 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 123/249] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:08 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:08.731489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:08.748779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6f032c1c-472d-45a4-baa5-a94f374c84a7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1510 microversion: 2.1 time: 0.225309 Sep 23 01:32:08.748779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 127/250] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:08 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:08.793131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:08.793435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:08.801921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.802576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.803322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.804080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.804601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.805891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.858819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:32:08.894773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:08.895383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:08.902020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.902429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.903083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:08.905072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:08.905897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:08.906970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.086176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:09.099416 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-30ec750b-9ed3-4b97-90f7-604275da7c58 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.208229 Sep 23 01:32:09.100471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 128/251] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:08 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:09.265930 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c64ca4d7-4947-4acc-95f5-bbceb7ac8b9e tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 204 len: 0 microversion: 2.1 time: 0.476202 Sep 23 01:32:09.267810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 124/252] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:32:08 2022] DELETE /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:32:09.275284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:09.276021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:09.287496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.289041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.289765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.290783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.291422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.292145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.491217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:09.505868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-83557d98-8fc3-4957-861b-2a544c1f342d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1504 microversion: 2.1 time: 0.234119 Sep 23 01:32:09.507046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 129/253] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:09 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:09.573650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:09.576324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:09.588532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.589590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.593211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.595074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.596258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.597230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.631154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:09.632219 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:09.643949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.644644 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.645775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.646909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.667806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.667806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.803510 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:09.834287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2bde6835-2c11-4657-9ff2-bd547ffee44a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1269 microversion: 2.1 time: 0.207731 Sep 23 01:32:09.834909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 130/254] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:09 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1269 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:09.861501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:09.862556 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:09.889502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.891651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.892588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.893304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:09.895393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:09.896846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:09.974063 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:09.993586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:09.997923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:10.001062 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f8994a3e-11b0-4e62-a2d7-e0eaa60fa47b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.435976 Sep 23 01:32:10.002856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 125/255] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:09 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:10.077778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:10.086062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-72defa67-321d-4090-aa39-ea6745efa73d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1510 microversion: 2.1 time: 0.247222 Sep 23 01:32:10.086684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 131/256] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:09 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:10.142002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:10.142773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:10.152725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.153217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.153719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.155316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.155803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.156261 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.360737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:10.375321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0c89d2a-8d8f-4bc6-82a4-caa5e0e3c5e5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.237960 Sep 23 01:32:10.376311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 126/257] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:10 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:10.551640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:10.552680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:10.564249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.564977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.565653 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.566594 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.567418 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.568208 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.809332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:10.818643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-62177ca0-5b2f-4cea-9a42-55529f263213 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1504 microversion: 2.1 time: 0.276757 Sep 23 01:32:10.819294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 132/258] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:10 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:10.882905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:10.884634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:10.896996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.897773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.898390 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.899535 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:10.900288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:10.900960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:10.998165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.006778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b3a171d4-35bd-4d71-b309-c61d0e8a2f15 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1269 microversion: 2.1 time: 0.134129 Sep 23 01:32:11.007371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 127/259] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:10 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1269 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:11.050804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:11.051465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:11.060028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.060592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.061037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.061957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.062415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.062886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.111427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:11.112281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:11.119252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.119789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.120230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.120948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.121404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.122055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.222900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.238833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.242191 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.244112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-33d8d53e-5107-4b1a-9905-914ff01e4649 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.197242 Sep 23 01:32:11.245018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 133/260] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:11 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:11.333498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.343600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-815e412c-dce7-4732-9c42-f1c48c24197a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1516 microversion: 2.1 time: 0.236818 Sep 23 01:32:11.344683 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 128/261] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:11 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1516 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:11.399895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:11.400733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:11.407824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.408691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.409125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.409828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.410308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.410725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.428458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:11.578258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:11.605467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-feeb6865-2119-4cf5-81ea-d7c1dc871a77 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.209439 Sep 23 01:32:11.606226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 134/262] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:11 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:11.847470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:11.847470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:11.854310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.854913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.855512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:11.856392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:11.857097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:11.857626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.044213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:12.045383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:12.057161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.058073 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.059215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.061165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.062050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.063066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.075394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:12.086726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-01ea7103-1965-41b3-abb6-49b71f400161 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1504 microversion: 2.1 time: 0.246651 Sep 23 01:32:12.087804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 129/263] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:11 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:12.207222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:12.222212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6712cde9-d3d5-4c53-ba18-3ec5203f59d3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1277 microversion: 2.1 time: 0.185311 Sep 23 01:32:12.224136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 135/264] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:12 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:12.279894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:12.282272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:12.286343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:12.297265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.298180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.298959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.300576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.301919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.302721 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.448457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=8 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:12.472041 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:12.481468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:12.482932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:12.484223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5eb52978-6d51-401c-adf2-9aff02e9b5c2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.214464 Sep 23 01:32:12.484790 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 130/265] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:12 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:12.634635 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:12.635026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:12.643630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.649003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.649003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:12.649003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:12.649003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:12.649772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.050934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.063321 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-173523a1-fcef-4c42-a3cb-d1cf80dbad3a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.432865 Sep 23 01:32:13.070532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 136/266] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:12 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:13.120864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:13.127771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:13.156060 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.163052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.164617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.166293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.170918 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.174648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.263414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:13.264419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:13.272623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.273589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.274531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.275792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.276838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.277485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.530544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.555957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5953d732-e271-48fd-8fc1-8c07ccbcb49d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1287 microversion: 2.1 time: 0.304484 Sep 23 01:32:13.556930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 137/267] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:13 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1287 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:13.562488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:13.563641 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:13.572246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.573375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.574189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.575117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:13.575832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:13.576479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:13.611882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:13.636957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.652717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5d8a9e2b-a0d9-46bc-9e8d-c07de21a2f76 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1504 microversion: 2.1 time: 0.541077 Sep 23 01:32:13.654317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 131/268] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:13 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:13.673891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8324d7b4-15e2-45eb-9ea6-303568e74898 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: .version_select at 0x7f76794a8820>, body: {"keypair": {"name": "tempest-keypair-46232254", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXt1xmmk6yl88mNRrY6pcqdTqWhZTWvpBjEWn+J2pZPeGeNmM7EwsUZ1vECGekIYfn6i2uvzziJDcgu1zzY0+vdIzJQVJCmj/Mjdd/G/HiQOUdlqw/GykMQXuIAOJlMTw=="}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:13.718839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-8324d7b4-15e2-45eb-9ea6-303568e74898 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:32:13.733169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-8324d7b4-15e2-45eb-9ea6-303568e74898 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for user da9978cab3fb4bdda39a2e4718ee2cc7 and project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:32:13.798786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.809312 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.811431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:13.812746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0ad6cb93-7bd8-4f26-9022-9b032a890aa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.254589 Sep 23 01:32:13.813455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 138/269] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:13 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:14.028630 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8324d7b4-15e2-45eb-9ea6-303568e74898 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.367336 Sep 23 01:32:14.029240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 132/270] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:32:13 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:14.043034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8e8957e-701e-458d-85dc-f85fadd5cd30", "name": "network-vif-deleted", "tag": "50f6d2ef-4fa7-4a7a-83e6-6a047944f173"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:14.054871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.055346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.055806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.073911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] Creating event network-vif-deleted:50f6d2ef-4fa7-4a7a-83e6-6a047944f173 for instance b8e8957e-701e-458d-85dc-f85fadd5cd30 on hv-cinder-84914 Sep 23 01:32:14.080832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-4c020eac-fa3b-41af-a2a1-417be39e1640 req-0a23ed10-e75f-4118-bb75-3b47643226e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041476 Sep 23 01:32:14.081958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 139/271] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:14.100642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:14.101252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:14.107250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.107764 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.108197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.108888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.109341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.109771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.303716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:14.315822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-82b9681c-b81c-421e-932f-3a130119fb10 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.218891 Sep 23 01:32:14.316404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 133/272] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:14 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:14.584520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:14.585481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:14.592990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.593476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.593902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.594604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.595050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.595464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.695998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:14.703401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:14.717440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.718848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.720383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.722671 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.724910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.725984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.773990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.774516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.774964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.775565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lazy-loading 'fault' on Instance uuid b8e8957e-701e-458d-85dc-f85fadd5cd30 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:32:14.851927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:14.855105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:14.864094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-20239834-bac3-48b5-be34-a2e5f5b9df59 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.284814 Sep 23 01:32:14.880858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 140/273] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:14 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:14.898299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f62478d2-4ab3-4048-a021-a474eee0855b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1304 microversion: 2.1 time: 0.205447 Sep 23 01:32:14.898299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 134/274] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:14 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1304 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:14.899254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:14.899254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:14.912787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.913554 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.928934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:14.929742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:14.930448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:14.931747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.196394 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:15.213648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:15.213648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:15.213648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-cca5ba5d-cd0f-4aef-b534-b0bf3a844523 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.327878 Sep 23 01:32:15.213999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 141/275] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:14 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:15.346913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:15.347665 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:15.355760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.356036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.356423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.357820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.358340 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.358756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.613532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:15.629842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3e3654e1-cf45-435a-986e-757b3aaa7187 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.289575 Sep 23 01:32:15.630483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 135/276] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:15 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:15.818237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2797dc79-1fc8-447f-865e-401bc4353e75", "tag": "a06eccad-6dd8-455b-a742-fada65ca5091"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:15.836199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.836687 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.837116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.851276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] Creating event network-changed:a06eccad-6dd8-455b-a742-fada65ca5091 for instance 2797dc79-1fc8-447f-865e-401bc4353e75 on hv-cinder-84914 Sep 23 01:32:15.856336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-b1b3056b-c454-4ad0-a5ad-f5271e31f317 req-f1ec4b59-7ec6-40de-a9eb-802b42dc5aa4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046139 Sep 23 01:32:15.857670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 142/277] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:15.921439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:15.922260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:15.922958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:15.926616 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:15.929691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.930534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.931232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.932186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.932804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.933746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.933872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.934373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.936419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.937415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.938195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.938859 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.988044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:15.988855 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:15.989452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:15.990058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lazy-loading 'fault' on Instance uuid b8e8957e-701e-458d-85dc-f85fadd5cd30 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:32:16.043027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:16.056713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2ab90462-5925-4cb0-a4ba-a9b10eead9f6 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 200 len: 1304 microversion: 2.1 time: 0.138000 Sep 23 01:32:16.073489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 143/278] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:15 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:16.254206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:16.255076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:16.262084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:16.262927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:16.263823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:16.265139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:16.265987 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:16.266753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:16.497218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:16.506967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:16.508957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:16.509974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b70a71d8-3ba9-4c8b-ba7b-ac89e681ddf0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.260115 Sep 23 01:32:16.516300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 144/279] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:16 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:16.559072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:16.569763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1adf2c9f-b001-49a5-ad87-0eb7ce2a4a8c tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.652959 Sep 23 01:32:16.572958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 136/280] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:15 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:16.658464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:16.659471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:16.667523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:16.668045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:16.668480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:16.669274 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:16.670428 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:16.670872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.072711 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:17.083336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8842ff77-6d56-45a6-8d61-4bc85c85fabe tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.432457 Sep 23 01:32:17.087013 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:17.088298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: b8e8957e-701e-458d-85dc-f85fadd5cd30] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:17.096235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.097303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.098002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.099293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.100268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.101007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.103029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 145/281] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:16 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:17.131911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] HTTP exception thrown: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Request method failure captured: Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 HTTP/1.1 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQyAxYbaC_Os6XMwHXylh-ArB7zfeb2GH28sy1Q8CknVW_GSrsEbzQPUbEhE_OFREosyg3ol3FijyuTIMaTUxW4gxBJm1pwJUbMlwESIEVlzHvSfSKgHj2o1aAe2_4yOJ6vFiWKUwxVF_t9Qpre_fTDxDfzzici15b_r4M9TUtKT7fw Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 3816d889342e400383f7e5e6f4ebbe04 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesActionsTest-871431131 Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:32:17.135376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3816d889342e400383f7e5e6f4ebbe04", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesActionsTest-871431131 Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 3816d889342e400383f7e5e6f4ebbe04 Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesActionsTest-871431131 Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesActionsTest-871431131-project Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1658e3b405ea41939ff42b6bb36d87f7 Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesActionsTest-871431131-project Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. Sep 23 01:32:17.137921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'b8e8957e-701e-458d-85dc-f85fadd5cd30'} Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:32:17.140440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. Sep 23 01:32:17.142656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:32:17.144788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Returning 404 to user: Instance b8e8957e-701e-458d-85dc-f85fadd5cd30 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:32:17.144788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bb546f95-4c4a-475f-8880-8759e3ad7adb tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30" status: 404 len: 111 microversion: 2.1 time: 0.056550 Sep 23 01:32:17.144788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 137/282] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:17 2022] GET /compute/v2.1/servers/b8e8957e-701e-458d-85dc-f85fadd5cd30 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:32:17.305276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-31848512", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "networks": [{"uuid": "9bf674af-206f-436e-bb8c-2e0cce6fc1f2"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:17.425724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] validate_networks() for [('9bf674af-206f-436e-bb8c-2e0cce6fc1f2', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:32:17.536837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:17.537900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:17.550632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.554473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.556183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.558647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.563668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.564446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.778021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:17.788524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:17.789960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:17.791246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0f6c0c0e-0c9d-449d-a65b-e743f77f8c34 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1746 microversion: 2.20 time: 0.258749 Sep 23 01:32:17.791856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 138/283] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:17 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1746 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:17.805468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:17.806616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:17.828290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.829626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.831850 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:17.835149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:17.836152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:17.836967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.019896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:18.023231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:18.031277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f13e21ec-43f0-4e51-a880-eb703ec80fb5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.229835 Sep 23 01:32:18.032420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 139/284] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:17 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:18.079376 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:32:18.080682 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:32:18.081036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:32:18.081783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:32:18.082327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:32:18.093601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.094403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.094832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.095591 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.096201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.096842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.116869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:18.119752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:18.128922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Getting quotas for project 3816d889342e400383f7e5e6f4ebbe04. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:32:18.135474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.136410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.136862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.137576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.138755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.139190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.141666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Getting quotas for user 1658e3b405ea41939ff42b6bb36d87f7 and project 3816d889342e400383f7e5e6f4ebbe04. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:32:18.158662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:32:18.162389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:32:18.304985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:18.323587 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4e877e6d-2f3f-471d-97cf-f409a197d6fe tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.022450 Sep 23 01:32:18.325017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 146/285] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:32:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:32:18.331717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fefd24db-0cef-4929-9dca-6fa36e9be04c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.221461 Sep 23 01:32:18.332870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 140/286] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:18 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:18.350994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9a6ba25c-fe1c-41c0-a990-7255d3b6a3f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:18.351539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9a6ba25c-fe1c-41c0-a990-7255d3b6a3f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:18.450664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9a6ba25c-fe1c-41c0-a990-7255d3b6a3f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:18.465390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9a6ba25c-fe1c-41c0-a990-7255d3b6a3f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1212 microversion: 2.1 time: 0.118090 Sep 23 01:32:18.476258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 147/287] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:18 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1212 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:18.827701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:18.828770 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:18.844383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.844383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.844383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:18.844383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:18.847439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:18.848223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:19.006645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2124158564", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f7b971fd-945f-4624-ba90-e53784d63da6"}], "security_groups": [{"name": "tempest-securitygroup--1169028609"}], "key_name": "tempest-keypair-46232254", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:19.056852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.070700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.072081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.074001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-63b34e3d-7e0b-4137-b2bb-8e6f300299b5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1746 microversion: 2.20 time: 0.259159 Sep 23 01:32:19.089568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 141/288] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:18 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1746 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:19.096272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:19.096272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:19.102360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:19.102874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:19.103310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:19.104094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:19.104740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:19.105025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:19.162495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] validate_networks() for [('f7b971fd-945f-4624-ba90-e53784d63da6', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:32:19.353640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.392732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-00571247-a82b-4560-8ee0-7477785039ec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.303186 Sep 23 01:32:19.393505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 142/289] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:19 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:19.402280 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:19.403401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:19.437420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:19.440453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:19.443433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:19.448915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:19.452233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:19.454296 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:19.479199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:19.718123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.729588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8a534655-e86a-4c02-ab2c-5f3c83649a42 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.333081 Sep 23 01:32:19.731654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 143/290] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:19 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:19.745740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6d7acd1f-db3e-4f5e-986b-aee575898b13 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:19.748521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6d7acd1f-db3e-4f5e-986b-aee575898b13 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:19.822317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6d7acd1f-db3e-4f5e-986b-aee575898b13 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:19.831539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6d7acd1f-db3e-4f5e-986b-aee575898b13 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1212 microversion: 2.1 time: 0.097071 Sep 23 01:32:19.832604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 144/291] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:19 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:20.052840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:32:20.053177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:32:20.053767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:32:20.054378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:32:20.054898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:32:20.066310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.066807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.067246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.068233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.068946 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.069589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.105105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:32:20.108779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:20.109529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:20.111521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Getting quotas for user da9978cab3fb4bdda39a2e4718ee2cc7 and project 1b8939e407ff4bdc81191af7f0593cd5. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:32:20.120656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.121607 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.122975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.124807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.125630 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.126090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.128447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:32:20.131182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:32:20.312090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d4e35e54-2aff-4cf4-a26f-9f89a8b2cd32 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.310300 Sep 23 01:32:20.313694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 148/292] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:32:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:32:20.329420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d9e11542-9bbd-49b1-9791-883973692606 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:20.330402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d9e11542-9bbd-49b1-9791-883973692606 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:20.350240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:20.368249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:20.370801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:20.375238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f2ec295a-d0bc-4c13-9b9f-ec133a39b1de tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1746 microversion: 2.20 time: 0.274525 Sep 23 01:32:20.389672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 145/293] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:20 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1746 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:20.408002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d9e11542-9bbd-49b1-9791-883973692606 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:20.415803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d9e11542-9bbd-49b1-9791-883973692606 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1244 microversion: 2.1 time: 0.091265 Sep 23 01:32:20.421238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:20.422562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:20.428673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 149/294] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:20 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:20.437621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.443402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.443402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.444188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.444687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.445392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.673393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:20.688163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ee7bbd45-0809-46ac-a6e4-d22423badc76 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.271799 Sep 23 01:32:20.689268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 146/295] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:20 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:20.764352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:20.765973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:20.773131 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.773900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.774499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.775662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.776276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.777207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.883575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:20.884664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:20.897416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.898258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.911780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:20.913540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:20.914971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:20.919466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.009279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.023226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-eddd2963-35f4-4ca7-aef6-ba1f443b2b1c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1723 microversion: 2.1 time: 0.264643 Sep 23 01:32:21.025068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 150/296] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:20 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:21.081101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.090475 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-27312a57-730d-459f-864a-542cfc8cd355 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1264 microversion: 2.1 time: 0.218460 Sep 23 01:32:21.091168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 147/297] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:20 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:21.410830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:21.413764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:21.428895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:21.430395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:21.439668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.439668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:21.444285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:21.444963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.446892 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-421e41ea-6652-432f-9d02-7f6c1b895468 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:21.447968 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-421e41ea-6652-432f-9d02-7f6c1b895468 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:21.531212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-421e41ea-6652-432f-9d02-7f6c1b895468 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.541751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-421e41ea-6652-432f-9d02-7f6c1b895468 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1244 microversion: 2.1 time: 0.101242 Sep 23 01:32:21.541751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 148/298] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:21 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:21.566531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "name": "network-vif-plugged", "status": "completed", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:21.584757 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:21.585196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:21.586233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.611420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] Creating event network-vif-plugged:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:32:21.617736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-40fa11ce-be0d-4407-831b-9c9e532c47d1 req-c4d8662f-7ff9-48bd-a55c-a6dc70d4a445 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056224 Sep 23 01:32:21.618343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 149/299] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:21.646788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.656877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.658574 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.659815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a2706f9f-3564-4d26-8aaf-39191c7c5537 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.258478 Sep 23 01:32:21.660388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 151/300] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:21 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:21.713760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:21.714523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:21.739655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:21.740206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:21.740685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.741419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:21.741894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:21.742319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:21.951366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:21.961195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-886971b1-e942-4b5d-918f-09bf21fe9eca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.252174 Sep 23 01:32:21.979908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 150/301] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:21 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:22.056438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:22.057479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:22.073012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.073956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.074637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.076039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.076800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.078303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.120094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:22.120982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:22.129888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.130656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.134684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.138933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.140154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.141709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.316349 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:22.404333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b151706e-47ab-4a75-aacb-d91f09a85e84 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1264 microversion: 2.1 time: 0.257132 Sep 23 01:32:22.429539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 151/302] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:22 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1264 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:22.448073 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:22.464893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c4d3353c-49da-48b3-9f9d-752d64ea15d4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1700 microversion: 2.1 time: 0.417201 Sep 23 01:32:22.467444 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 152/303] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:22 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1700 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:22.504722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:22.508789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:22.513699 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.514200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.519738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.569036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:22.570130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:22.584386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.587988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.588959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.591193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.593061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.594777 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.607180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Going to try to start instance {{(pid=121763) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 01:32:22.797466 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:22.816233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-899f34b6-505d-4048-ab6d-1c3927934c98 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1240 microversion: 2.1 time: 0.252528 Sep 23 01:32:22.817552 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 153/304] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:22 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1240 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:22.839801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:22.840433 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:22.849251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.850069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.850506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.851219 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.851692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.852106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.933901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6dc54fcf-f5a8-429d-9bdf-c0fb5feb069e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action" status: 202 len: 0 microversion: 2.1 time: 0.432997 Sep 23 01:32:22.938489 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 152/305] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:32:22 2022] POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:32:22.950422 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:22.951391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:22.959113 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.960660 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.961369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:22.962272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:22.963032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:22.963706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:23.148226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:23.177516 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:23.179265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:23.191894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-249ca5bb-16a8-4b55-b25e-cf7c3b06aa06 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.368986 Sep 23 01:32:23.207581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 154/306] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:22 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:23.207581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:23.207581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:23.223000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:23.223541 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:23.226349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:23.228223 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:23.232278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:23.232278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:23.259260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:23.384763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:23.402255 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-80f2a125-6814-47a1-9de8-66ebd406c8a4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1709 microversion: 2.1 time: 0.461277 Sep 23 01:32:23.406816 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 153/307] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:22 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1709 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:23.448845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:23.448845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:23.463321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:23.475881 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:23.481526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:23.488279 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:23.488279 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:23.490961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:23.841140 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:23.852693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ad51dfe0-da10-4712-8353-c2715a007741 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.655714 Sep 23 01:32:23.857154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 155/308] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:23 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:24.107175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:24.107175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:24.109990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:24.109990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d2b2fe22-f871-4e64-b8d9-9ed3a24d6f4b tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1270 microversion: 2.1 time: 0.459721 Sep 23 01:32:24.109990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 154/309] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:23 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1270 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:24.111236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.111236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.111236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.111236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.112059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.112059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.113014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2797dc79-1fc8-447f-865e-401bc4353e75", "name": "network-vif-plugged", "status": "completed", "tag": "a06eccad-6dd8-455b-a742-fada65ca5091"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:24.113014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.113014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.113014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.113702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] Creating event network-vif-plugged:a06eccad-6dd8-455b-a742-fada65ca5091 for instance 2797dc79-1fc8-447f-865e-401bc4353e75 on hv-cinder-84914 Sep 23 01:32:24.113702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-8fcd7db7-3d60-43e4-bedc-32a3224c3fd6 req-3e31cf97-5f9c-413a-93e6-4bef9dbbde28 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070709 Sep 23 01:32:24.113702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 155/310] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:32:24.114099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:24.114099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6827b1f2-de34-4dd7-a828-62a44da0a6d3 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1296 microversion: 2.1 time: 0.195074 Sep 23 01:32:24.114099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 156/311] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:23 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1296 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:24.227573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:24.228485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:24.236417 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.237364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.238029 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.238972 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.239723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.240363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.438004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:24.439201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:24.453738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.458511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.462049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.465286 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.467861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.469549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.699431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:24.709930 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:24.712054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:24.716628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-659817f8-8abc-4506-8dc3-fe6eebdd4178 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.490857 Sep 23 01:32:24.716628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 156/312] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:24 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:24.907319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:24.913128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:24.932527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.935161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.938036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:24.940875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:24.941640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:24.942697 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.013850 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:25.033481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-56e527e5-4416-4c00-9e85-299dd8486d90 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1709 microversion: 2.1 time: 0.599690 Sep 23 01:32:25.034437 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 157/313] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:24 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1709 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:25.040309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:25.046224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:25.060568 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.064175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.064175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.064175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.064175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.064738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.169260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:25.178207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6093c3b0-6786-4257-9670-0a4a84c00a66 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.278902 Sep 23 01:32:25.188177 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 157/314] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:24 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:25.192384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:25.195905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:25.222385 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.223078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.224441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.228842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.229603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.232222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.407605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:25.411304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:25.422953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b90d8245-afa4-4202-b160-1e04c64695f0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1304 microversion: 2.1 time: 0.236526 Sep 23 01:32:25.435680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 158/315] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:25 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1304 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:25.515289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:25.547356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-697098cb-fd74-4e84-8d0a-cdc443eab3e8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.511149 Sep 23 01:32:25.548153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 158/316] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:25 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:25.744615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:25.748796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:25.770903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.776302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.776302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:25.776302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:25.776302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:25.779151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.061733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:26.063203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:26.077583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.082467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.085537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.087749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.089911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.093958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.120369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.132584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.137165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.144306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d74e30ee-c025-4771-a3bb-a22984e30b5f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.402424 Sep 23 01:32:26.160143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 159/317] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:25 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:26.230627 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:26.232464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:26.246969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.248572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.249016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.249729 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.250192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.251142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.460293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.473525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e6f71615-cc16-42d6-abf0-be508968e367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1709 microversion: 2.1 time: 0.412635 Sep 23 01:32:26.476753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 159/318] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:26 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1709 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:26.496934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:26.498234 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:26.505491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.508254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.514676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.519756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.521845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.526570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.534278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.543513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0afbccb9-7f8a-48d6-b322-e532f19b906a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1317 microversion: 2.1 time: 0.320351 Sep 23 01:32:26.544299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 160/319] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:26 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:26.589148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:26.589866 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:26.602302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.608039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.613935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.613935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.613935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.613935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.717895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:26.731324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-669e6309-b3f4-4a67-bd11-5e8a4e72b9c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1302 microversion: 2.1 time: 0.251317 Sep 23 01:32:26.733497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 160/320] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:26 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:26.745615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6", "tag": "e1685418-9463-45a4-b038-692645ce18c7"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:26.769561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:26.769561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:26.769561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:26.797542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] Creating event network-changed:e1685418-9463-45a4-b038-692645ce18c7 for instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 on hv-cinder-84914 Sep 23 01:32:26.810350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-643a7c87-0d71-4f23-91bd-e512293326d9 req-ccc9359f-95dd-41a2-8eab-074b053fd97b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070274 Sep 23 01:32:26.810350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 161/321] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:26.999248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.008513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1f99fab5-5155-4d69-bc84-baa4b7e46b80 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.423268 Sep 23 01:32:27.009393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 161/322] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:26 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:27.182768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:27.184503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:27.197235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.198027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.198648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.200046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.202605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.204782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.386715 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.395685 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.397324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.398445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-89e6c66e-3916-4927-9043-ccdfa06be27f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.227833 Sep 23 01:32:27.398936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 162/323] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:27 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:27.503926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:27.505253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:27.523166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.523166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.523166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.523166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.523609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.523609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.597191 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:27.597810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:27.608874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.609725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.610744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.611903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.612748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.613523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.840805 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.871125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5dc9127f-0e71-450b-af1f-810903adb182 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1709 microversion: 2.1 time: 0.371189 Sep 23 01:32:27.873515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 162/324] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:27 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1709 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:27.880995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:27.881922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:27.890785 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.891694 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.892935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.893837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:27.894458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:27.895270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:27.897878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:27.908882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c5e4d3db-fd63-45c4-8ae8-132a2090be36 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1506 microversion: 2.1 time: 0.316183 Sep 23 01:32:27.923059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 163/325] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:27 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:28.033136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:28.033913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:28.041683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.042638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.043192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.044248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.044972 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.045494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.230337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:28.265749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-eb00d52c-272d-4416-bf4a-e8c9d299fb28 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.387488 Sep 23 01:32:28.269173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 163/326] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:27 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:28.426409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:28.427797 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:28.454873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.457359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.457359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.458573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.460546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.461836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.484424 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:28.570193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1f2de5d4-7bf8-40b9-b35d-17ee23c9192c tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.525578 Sep 23 01:32:28.577456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 164/327] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:28 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:28.903096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:28.903787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:28.929409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.929901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.936184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.938787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:28.940181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:28.940595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:28.977886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:28.994942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:29.003717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:29.012594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-72b2edd2-6256-4c0c-a034-7b49a01e7ad3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.590306 Sep 23 01:32:29.014344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 164/328] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:28 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:29.295599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:29.297227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:29.322331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:29.327424 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:29.328771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:29.330419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:29.341954 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:29.344149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:29.496291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:29.510841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-19dba5aa-a539-42d2-9c37-ee0b718d920c tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1713 microversion: 2.1 time: 0.610621 Sep 23 01:32:29.512980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 165/329] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:28 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1713 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:29.601994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:29.602835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:29.619197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:29.620436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:29.624758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:29.632034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:29.633371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:29.634056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:29.634893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:29.637564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-dc7c0530-390b-49be-8e1f-3bbd8b19036c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.348100 Sep 23 01:32:29.639244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 165/330] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:29 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:29.930167 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:29.939361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fd3de040-57e1-45e5-9918-b4207e88cc86 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.342158 Sep 23 01:32:29.944313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 166/331] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:29 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:30.069997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:30.071389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:30.085227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.086157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.086786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.087852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.088529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.089329 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.331801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:30.352540 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:30.355274 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.360127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.362658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.392351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] Creating event network-changed:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:32:30.397280 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:30.398019 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-15119577-9968-4d03-b1c7-2e1303aae014 req-fb30e1bc-1f3f-463a-95f2-9f1a3b0d76b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070884 Sep 23 01:32:30.398961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 167/332] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:32:30.418333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:30.422300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:30.425530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cb3768b5-e904-4a85-b164-9a7807a0c96e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.362638 Sep 23 01:32:30.427574 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 166/333] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:30 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:30.669353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:30.671052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:30.673888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=16 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:30.702983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.705044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.705637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.706828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.710014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.710845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.968535 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:30.969822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:30.982155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.982656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.990288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:30.991629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:30.992177 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:30.992645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:31.286285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:31.304216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-68da5626-d70b-4ccf-8bfa-8fb51e49442a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.642346 Sep 23 01:32:31.304818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 168/334] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:30 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:31.461995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:31.478677 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:31.479821 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:31.489152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-24d157f2-48f2-4f14-9da0-a961bc3bf698 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.525622 Sep 23 01:32:31.490112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 167/335] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:30 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:31.491438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:31.492701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:31.494188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:31.495328 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:31.496266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:31.497169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:31.888441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:31.904871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:31.912217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:31.913658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-829e6a7f-212a-4130-bbc5-3e76d3a864f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.454177 Sep 23 01:32:31.914233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 169/336] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:31 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:32.344750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=8 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:32.348903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:32.349512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:32.357248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.357754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.358170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:32.358955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.359414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.359926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:32.514897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:32.515517 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:32.536597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.537408 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.538031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:32.538950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.539619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.540249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:32.623909 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:32.637933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0bd2c894-6ea0-4d69-81de-0c68ea4b4354 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.293665 Sep 23 01:32:32.660233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 168/337] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:32 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:32.918192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:32.927692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fb8af716-d97c-4b55-8ef4-5baf33dc4950 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.416937 Sep 23 01:32:32.929134 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 170/338] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:32 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:32.973988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:32.974606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:32.981359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.981877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.982298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:32.983207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:32.983976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:32.984636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:33.259808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:33.271788 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:33.273832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:33.276282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8d6cc6ee-ca64-41e0-94c9-281398b68a91 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.306259 Sep 23 01:32:33.277563 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 169/339] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:32 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:33.672737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:33.673718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:33.681526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:33.682016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:33.682442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:33.683144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:33.683629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:33.684130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:33.849680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:33.862959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d9ca19ca-a98a-4057-ae2b-9475f944668e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.194875 Sep 23 01:32:33.879585 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 171/340] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:33 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:33.955466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:33.959130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:33.964775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:33.965401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:33.966104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:33.966928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:33.967795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:33.968349 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.120986 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:34.131122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-84ba12b8-11cf-45d2-b4cc-007d95f41fe4 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.180555 Sep 23 01:32:34.132467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 170/341] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:33 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:34.326891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:34.328060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:34.355812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:34.356704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:34.357444 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.358684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:34.363231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:34.364253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.591488 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6", "name": "network-vif-plugged", "status": "completed", "tag": "e1685418-9463-45a4-b038-692645ce18c7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:34.617098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:34.623068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:34.625401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:34.626136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.629218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:34.631177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:34.632497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-57a439f5-edef-413e-aec4-374aee85740e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.328606 Sep 23 01:32:34.634012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 172/342] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:34 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:34.659381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] Creating event network-vif-plugged:e1685418-9463-45a4-b038-692645ce18c7 for instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 on hv-cinder-84914 Sep 23 01:32:34.708732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-1faff1a5-c3b9-4830-8826-5da537620051 req-d3711cad-fe70-496f-8125-2355b0e97b28 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083906 Sep 23 01:32:34.708732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 171/343] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:34.892658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:34.893781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:34.905264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:34.906369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:34.909375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.909375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:34.909375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:34.909375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:34.929926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:35.162307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:35.163213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:35.179767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:35.182895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:35.184772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:35.189828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:35.189828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:35.189828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:35.201718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:35.214949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d84077ed-945d-44f0-beea-a8645fec8e60 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.327292 Sep 23 01:32:35.225571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 173/344] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:34 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:35.700206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:35.700962 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:35.718652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:35.719128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:35.719613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:35.720311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:35.720850 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:35.721290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:35.990603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:36.006432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0c77348-519e-41bc-8a09-8536f2e36f50 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.849601 Sep 23 01:32:36.032711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 172/345] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:35 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:36.067358 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:36.080984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:36.085566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:36.091909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0fb9e9d4-2836-4bd3-9885-7622f6b0b514 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.409142 Sep 23 01:32:36.095435 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 174/346] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:35 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:36.246446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:36.247295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:36.257828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:36.258433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:36.258953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:36.259700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:36.260162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:36.261393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:36.523438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:36.540468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ac131a12-69ed-4071-a939-f9c290a3bee8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.299491 Sep 23 01:32:36.544585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 173/347] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:36 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:37.076700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:37.078900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:37.099412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.100127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.100718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.101893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.103361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.103361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.136001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:37.145428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:37.174659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.184078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.185389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.186595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.187406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.188194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.536645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:37.564142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5f81c858-e4d4-4f6e-b372-c9520c9a3c37 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.495332 Sep 23 01:32:37.565971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 175/348] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:37 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:37.577719 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:37.579230 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:37.588842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.589834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.590600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.591996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:37.593279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:37.594027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:37.634187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:37.659525 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:37.661529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:37.663759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0dc6bb5b-52eb-4add-886b-ae6022f8b6b2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.533367 Sep 23 01:32:37.673244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 174/349] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:37 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:37.949555 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:37.972041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-60b2a74c-4c40-4e81-8fed-edbf646fc4e4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.401815 Sep 23 01:32:37.973375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 176/350] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:37 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:38.622384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:38.623743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:38.638691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:38.641135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:38.642186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:38.643956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:38.645208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:38.646347 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:38.707846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:38.708440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:38.716353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:38.716848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:38.717250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:38.718231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:38.718697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:38.719127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:38.888466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:38.905677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-85677aa0-ca98-4c9c-bba5-899f93cad80d tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.291243 Sep 23 01:32:38.906778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 175/351] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:38 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:38.949570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:38.982779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:38.985696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:38.987469 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4de5593c-a6e9-48a0-82f2-803742f5184a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.288371 Sep 23 01:32:38.988329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 177/352] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:38 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:39.028705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:39.029360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:39.040817 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:39.041465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:39.041964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:39.043049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:39.044046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:39.044761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:39.050025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:39.265267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:39.279728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-23fe8fc2-6649-4c65-a7eb-0a05add5a374 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.262414 Sep 23 01:32:39.280800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 176/353] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:39 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:39.945758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:39.946875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:39.960491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:39.961354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:39.962069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:39.963330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:39.965079 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:39.979082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:40.026702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:40.033965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:40.078560 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:40.085058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:40.086032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:40.093312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:40.099960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:40.101940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:40.394735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:40.416116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3310c4e3-2d60-40e7-a51b-23e9a68311be tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1312 microversion: 2.1 time: 0.476838 Sep 23 01:32:40.418216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 178/354] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:39 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1312 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:40.429878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:40.431290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:40.443763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:40.445182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:40.446401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:40.448599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:40.451790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:40.451790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:40.520615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:40.520615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:40.521149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:40.522800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-52d53acc-113f-4683-983f-125fab4dbde0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.504941 Sep 23 01:32:40.524012 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 177/355] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:40 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:40.730160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:40.753440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bd69fefa-e62a-45b4-b2d0-64e65b6205c2 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.330937 Sep 23 01:32:40.754476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 179/356] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:40 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:40.991451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "name": "network-vif-plugged", "status": "completed", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:41.007157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.013600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.013600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.034061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] Creating event network-vif-plugged:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:32:41.044026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-c676f5b2-507c-4781-94d4-65c42cb08815 req-8955f1b1-9442-461f-a000-0fb16248f697 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057530 Sep 23 01:32:41.045258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 178/357] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:32:41.458739 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:41.460038 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:41.474932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.474932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.476299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.476846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.477708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.478462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.565353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:41.566680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:41.576796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.577677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.578377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.579810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.580428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.580958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.838367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:41.854837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:41.859307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:41.862020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a2a9aca5-4889-45f9-b7c1-2a01256fd9e0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1741 microversion: 2.20 time: 0.302818 Sep 23 01:32:41.863502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 179/358] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:41 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1741 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:41.874378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:41.876650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:41.889171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.890222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.891170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.892436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:41.893452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:41.894405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:41.896622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:41.921744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-17e17ee0-7d54-438b-9d5d-912614dd3fb9 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1496 microversion: 2.1 time: 0.466944 Sep 23 01:32:41.938265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 180/359] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:41 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1496 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:42.202247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:42.215532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-dd324c75-0210-4f30-9463-09d8ac39cbd7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.349453 Sep 23 01:32:42.216601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 180/360] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:41 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:42.904113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:42.905646 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:42.920087 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:42.920776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:42.923006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:42.923006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:42.923006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:42.923949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:43.187007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:43.198924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:43.200585 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:43.202185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bc53cc9c-1d36-43f1-ab73-ac6a6142b6fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1723 microversion: 2.20 time: 0.303050 Sep 23 01:32:43.202802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 181/361] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:42 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1723 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:43.251282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:43.252293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:43.260444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:43.260917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:43.261358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:43.262117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:43.262608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:43.263068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:43.589230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:43.606752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b4c97117-8236-4ed3-82b3-8f325398e4ea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1370 microversion: 2.1 time: 0.360759 Sep 23 01:32:43.607501 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 181/362] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:43 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:43.629872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:43.630884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:43.642007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:43.642815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:43.643600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:43.645116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:43.645866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:43.646581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:43.682581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:32:44.141926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-97d2e1f7-19f1-460e-8b43-cfceb9c4ecde tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "DELETE /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 204 len: 0 microversion: 2.1 time: 0.519585 Sep 23 01:32:44.142726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 182/363] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:32:43 2022] DELETE /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:32:44.151775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:44.152479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:44.158793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.159282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.159771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.160580 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.161051 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.161614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.232079 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:44.233237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:44.243166 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.247609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.247609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.247609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.247609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.248940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.364321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:44.379362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5d7c7ba0-a35d-43e7-a37d-d9dd2ce6afa7 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1502 microversion: 2.1 time: 0.231100 Sep 23 01:32:44.384768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 182/364] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:44 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:44.443922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:44.453289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:44.454878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:44.456247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-711da4ec-74bb-4ffb-995e-68bc8d9b1893 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1723 microversion: 2.20 time: 0.229484 Sep 23 01:32:44.456831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 183/365] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:44 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:44.660998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:44.662474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:44.684664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.685552 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.686386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.687895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.688812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.689714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.787380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "name": "network-vif-unplugged", "status": "completed", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:44.814452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.819860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.819860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.835949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] Creating event network-vif-unplugged:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:32:44.843526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-b5686b97-5537-4b90-9d08-3ae94ed3b387 req-a2c34c76-f89c-49fc-8c48-71feb2170419 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061983 Sep 23 01:32:44.848257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 184/366] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:44.923236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:44.931857 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f058f794-575b-43c9-921b-6fd524e980a1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1564 microversion: 2.1 time: 0.301861 Sep 23 01:32:44.933231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 183/367] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:44 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1564 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:44.961351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:44.961955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:44.971702 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.972328 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.972973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:44.973827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:44.974665 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:44.975140 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:45.100411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8aa37a8c-aeae-4984-badb-1516572bf372 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143993 Sep 23 01:32:45.101519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 185/368] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:32:44 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:45.411484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:45.412628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:45.424613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:45.425446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:45.426529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:45.427888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:45.428745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:45.429471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:45.493814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:45.495694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:45.507491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:45.513513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:45.513513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:45.513513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:45.513513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:45.513919 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:45.714811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:45.727961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:45.729179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:45.730536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f5224dc0-52aa-42d7-973a-46352c3fa981 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1723 microversion: 2.20 time: 0.243705 Sep 23 01:32:45.736316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 186/369] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:45 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:32:45.908951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:45.919605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5c8e42f9-c7c2-4023-8b11-2681e9c564f3 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1502 microversion: 2.1 time: 0.516223 Sep 23 01:32:45.920225 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 184/370] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:45 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1502 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:46.762180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:46.764647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:46.771050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:46.779074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:46.783142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:46.783142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:46.783142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:46.783142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:46.783822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:46.959365 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:46.961975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:46.980458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:46.982224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:46.983724 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:46.986055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:46.987175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:46.988638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:47.155691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:47.175808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:47.181619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:47.195642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bde97147-aedc-4830-8eb8-f02dc57c5a71 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1723 microversion: 2.20 time: 0.430460 Sep 23 01:32:47.218001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 187/371] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:46 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:47.239777 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:47.270874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:47.271940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:47.276391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:47.305034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] Creating event network-changed:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:32:47.319302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-92a125d2-5fc2-4d0b-8221-5f8046dd0c7e req-199bc482-9fdf-4b5a-8e14-052fe90a32a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087942 Sep 23 01:32:47.319302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 188/372] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:47.358341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:47.368386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d23152a1-da92-4195-9367-c827bbb88be8 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1502 microversion: 2.1 time: 0.424413 Sep 23 01:32:47.370056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 185/373] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:46 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:48.263776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:48.265318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:48.287163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:48.287764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:48.288343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:48.290293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:48.292582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:48.294260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:48.401037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:48.404253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:48.414359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:48.415146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:48.415833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:48.416983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:48.417495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:48.417949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:48.598217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:48.614666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:48.619448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:48.622309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fe750c0a-349f-4b4c-af90-6a522362f9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1723 microversion: 2.20 time: 0.390158 Sep 23 01:32:48.624107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 189/374] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:48 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1723 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:48.760221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:48.783418 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a20a8994-9b10-402b-9f8d-dfa8d4423f4a tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1502 microversion: 2.1 time: 0.390847 Sep 23 01:32:48.796344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 186/375] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:48 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1502 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:49.676547 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:49.677339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:49.706453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:49.710756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:49.713820 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:49.718150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:49.722523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:49.724406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:49.735668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:49.830659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:49.836701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:49.861223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:49.863708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:49.870516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:49.884284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:49.885754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:49.887162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:50.195366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:50.208117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:50.209813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:50.211072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a8def522-d264-428b-bf5f-1afbf0fc1d92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1726 microversion: 2.20 time: 0.544082 Sep 23 01:32:50.212103 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 190/376] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:49 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1726 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:50.254238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d21352-9172-4c14-be79-5eed01e48cb0"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:50.257481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:50.271485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:50.273254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:50.274807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:50.292669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:50.301527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:50.302463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:50.303190 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:50.336648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-830616f6-7ed0-46ed-9779-8e9bcdd493f1 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1502 microversion: 2.1 time: 0.497005 Sep 23 01:32:50.341363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 187/377] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:49 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1502 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:50.414488 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6", "name": "network-vif-deleted", "tag": "e1685418-9463-45a4-b038-692645ce18c7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:50.431827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:50.432791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:50.433623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:50.458160 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] Creating event network-vif-deleted:e1685418-9463-45a4-b038-692645ce18c7 for instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 on hv-cinder-84914 Sep 23 01:32:50.467454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-b252cfb0-9b55-4786-a311-5c693f917097 req-1457542e-a509-48b9-b17e-abdcea0523ff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060756 Sep 23 01:32:50.469081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 188/378] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:32:51.400021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:51.401311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:51.416232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:51.418413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:51.419270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:51.421377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:51.423412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:51.424820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:51.502000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:51.502801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:51.503653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:51.504467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lazy-loading 'fault' on Instance uuid eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:32:51.589839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1658e3b405ea41939ff42b6bb36d87f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3816d889342e400383f7e5e6f4ebbe04', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:51.605567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c5ab2417-c150-4d0b-a8e8-8f12aa341def tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 200 len: 1302 microversion: 2.1 time: 0.214842 Sep 23 01:32:51.608790 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 189/379] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:51 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 1302 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:52.405637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aa410a6-669b-4ecc-959c-937439c37e79", "device": "/dev/sdb"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:52.409074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:52.417625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:52.418346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:52.419410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:52.427315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:52.427315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:52.427315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:52.856807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6627796a-82a1-43bf-b1e9-85304ad68731 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.608515 Sep 23 01:32:52.857673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 191/380] 10.222.0.64 () {62 vars in 1364 bytes} [Fri Sep 23 01:32:50 2022] POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments => generated 188 bytes in 2611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:32:52.865672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1367682782", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:52.940649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] validate_networks() for None {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:32:53.398043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:32:53.398795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:32:53.399674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:32:53.400419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:32:53.401171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:32:53.417686 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.418465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.419135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.420494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.421343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.422110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.459579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Getting quotas for project 84a9bb6a15444802af12e048ea53223d. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:32:53.471145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Getting quotas for user 69e81cfb7aa24918b5ec8b32064e17eb and project 84a9bb6a15444802af12e048ea53223d. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:32:53.491802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:32:53.498736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:32:53.668271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-412fc6cc-2a37-41ba-a424-095d5ee0a3a2 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809141 Sep 23 01:32:53.671765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 192/381] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:32:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:32:53.681668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:53.682779 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] [instance: eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:53.699049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.699863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.700307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.702005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.702005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.702005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.719077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] HTTP exception thrown: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Request method failure captured: Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 HTTP/1.1 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQyAxYbaC_Os6XMwHXylh-ArB7zfeb2GH28sy1Q8CknVW_GSrsEbzQPUbEhE_OFREosyg3ol3FijyuTIMaTUxW4gxBJm1pwJUbMlwESIEVlzHvSfSKgHj2o1aAe2_4yOJ6vFiWKUwxVF_t9Qpre_fTDxDfzzici15b_r4M9TUtKT7fw Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 3816d889342e400383f7e5e6f4ebbe04 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesActionsTest-871431131 Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:32:53.720791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3816d889342e400383f7e5e6f4ebbe04"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3816d889342e400383f7e5e6f4ebbe04", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesActionsTest-871431131 Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 3816d889342e400383f7e5e6f4ebbe04 Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesActionsTest-871431131 Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesActionsTest-871431131-project Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1658e3b405ea41939ff42b6bb36d87f7 Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesActionsTest-871431131-project Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. Sep 23 01:32:53.722483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6'} Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:32:53.723257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. Sep 23 01:32:53.726600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:32:53.728559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] Returning 404 to user: Instance eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:32:53.728559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0601351d-7ac5-4b0d-81c1-0defe3497134 tempest-VolumesActionsTest-871431131 tempest-VolumesActionsTest-871431131-project] 10.222.0.64 "GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6" status: 404 len: 111 microversion: 2.1 time: 0.049021 Sep 23 01:32:53.728559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 193/382] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:53 2022] GET /compute/v2.1/servers/eeb1c0b5-c4e7-4033-90d3-e6f08b13e2f6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:32:53.740932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:32:53.741750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:53.750494 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.751324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.751813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.757970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:53.757970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:53.757970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:53.841593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c9fdc383-abb6-458b-a0da-669bf4fd4fa2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "POST /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.436934 Sep 23 01:32:53.847405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121762) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 01:32:53.848126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 190/383] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:32:52 2022] POST /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75/os-volume_attachments => generated 194 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:32:53.874215 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5b547efb-8144-4b0c-92c6-d975687c97ff tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:53.875675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5b547efb-8144-4b0c-92c6-d975687c97ff tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:54.006253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5b547efb-8144-4b0c-92c6-d975687c97ff tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:54.016213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5b547efb-8144-4b0c-92c6-d975687c97ff tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1215 microversion: 2.1 time: 0.165955 Sep 23 01:32:54.017195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 191/384] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:53 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1215 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:54.327796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6bfbdb3d-e23c-40a9-8ac8-66aa55610204 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/action" status: 202 len: 0 microversion: 2.20 time: 0.598910 Sep 23 01:32:54.331812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 194/385] 10.222.0.64 () {62 vars in 1319 bytes} [Fri Sep 23 01:32:53 2022] POST /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:32:54.337918 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:54.338687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:54.348394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:54.349791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:54.349791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:54.350579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:54.364333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:54.365096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:54.570196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:54.587057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:54.590229 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:54.592213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d6ae7146-ceeb-4b16-ba63-a01c9f4e873e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1752 microversion: 2.20 time: 0.258542 Sep 23 01:32:54.593227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 192/386] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:54 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1752 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:55.059445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f5f927dd-c7d5-443c-8f4a-ed6dab725a30 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:55.060100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f5f927dd-c7d5-443c-8f4a-ed6dab725a30 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:55.130364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f5f927dd-c7d5-443c-8f4a-ed6dab725a30 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:55.139915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f5f927dd-c7d5-443c-8f4a-ed6dab725a30 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1215 microversion: 2.1 time: 0.084823 Sep 23 01:32:55.140515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 195/387] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:55 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:55.634640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:55.636715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:55.647893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:55.649183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:55.650195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:55.651317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:55.652098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:55.652650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:55.679520 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:55.872802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:55.891088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:55.894090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:55.899726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a12f45f8-a521-4a34-9d76-1c9239e7404c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1752 microversion: 2.20 time: 0.268631 Sep 23 01:32:55.899726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 193/388] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:55 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:56.168082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:56.169303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:56.181815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:56.182298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:56.182774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:56.183485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:56.184425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:56.184768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:56.296159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:56.320510 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a343756f-32e8-4fac-bbdc-f51d28145005 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1219 microversion: 2.1 time: 0.159534 Sep 23 01:32:56.322636 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 196/389] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:56 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1219 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:56.942458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:56.943636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:56.948533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=88 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:32:56.959220 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:56.960169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:56.960979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:56.962294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:56.963137 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:56.963950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:57.189859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:57.200413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:57.200723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:57.201934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c62311ee-10b1-4449-8087-086c4514b873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1752 microversion: 2.20 time: 0.267568 Sep 23 01:32:57.202515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 194/390] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:56 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1752 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:57.362430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:57.363182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:57.370427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:57.370921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:57.371367 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:57.372750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:57.373171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:57.373592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:57.488695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:57.504309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-69fcfe58-206e-427a-ac84-dc94599424d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1267 microversion: 2.1 time: 0.145606 Sep 23 01:32:57.505069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 197/391] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:57 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:32:58.229927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:58.230778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:58.239173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:58.239820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:58.240184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:58.240900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:58.241391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:58.241817 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:58.416693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:58.427403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:58.429159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:58.430832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c52dcfc8-9269-4f42-b0cd-fdebc7f1e144 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1752 microversion: 2.20 time: 0.205531 Sep 23 01:32:58.431423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 195/392] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:58 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:58.550284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:58.550284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:58.551334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:58.552004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:58.552543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:58.553370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:58.553927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:58.554446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:58.642936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:58.652151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ece2099d-fb2f-4eb6-8b27-c9c594370222 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1267 microversion: 2.1 time: 0.113362 Sep 23 01:32:58.652747 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 198/393] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:58 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1267 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:32:59.463383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:59.464595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:59.476641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:59.477762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:59.478341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:59.479748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:59.480558 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:59.481580 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:59.688004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:32:59.689282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:32:59.698158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:59.703383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:59.704982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:59.705728 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:59.707281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:32:59.708209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:32:59.709092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:32:59.726499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:59.729862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:59.732469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-19fbcaf0-e3a4-41f9-9e56-898224f2cfa2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1752 microversion: 2.20 time: 0.276380 Sep 23 01:32:59.748923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 196/394] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:32:59 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1752 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:32:59.841764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:32:59.851815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8dbf768e-dca1-4874-b4bf-2c27994afc8b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1267 microversion: 2.1 time: 0.173408 Sep 23 01:32:59.855343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 199/395] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:32:59 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:00.783066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:00.784509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:00.797477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:00.798980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:00.800191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:00.801355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:00.802259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:00.803111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:00.898376 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:00.903599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:00.929385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:00.944403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:00.946043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:00.948837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:00.953392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:00.955145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:01.099409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:01.117954 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d85652d0-268a-4bc7-9879-b0101300999c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1275 microversion: 2.1 time: 0.240391 Sep 23 01:33:01.119456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 200/396] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:00 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1275 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:01.163294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:01.177332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:01.192037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:01.193399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-abd2ac7a-8d48-4f40-b8a7-7333ad801773 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.418119 Sep 23 01:33:01.193993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 197/397] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:00 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:02.181988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:02.186928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:02.214762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:02.216021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:02.217026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:02.218709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:02.219782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:02.220898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:02.232733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:02.234304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:02.265896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:02.268703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:02.275437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:02.277211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:02.278775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:02.279941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:02.394374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:02.431802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d4535ad0-0566-4e32-9c85-75727c0ef9b5 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1273 microversion: 2.1 time: 0.264166 Sep 23 01:33:02.433157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 201/398] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:02 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1273 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:02.677326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:02.713354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:02.715334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:02.717447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-901337e8-7eae-4d37-82e5-14a0761463a4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.498692 Sep 23 01:33:02.732781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 198/399] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:02 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:03.463377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:03.464216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:03.469262 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:03.486895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:03.494749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:03.496242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:03.497775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:03.499043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:03.500276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:03.750217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:03.752057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:03.773651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:03.774198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:03.774958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:03.775837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:03.776622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:03.777118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:04.015802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:04.019500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:04.045746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:04.048346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:04.050459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c6345f2d-128c-420d-81c1-dd71b03574fd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.305466 Sep 23 01:33:04.063595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 199/400] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:03 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:04.110878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:04.131452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8d898b84-e981-4bb3-b8e9-143c39d034b0 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.677098 Sep 23 01:33:04.133302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 202/401] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:03 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:05.092357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:05.093700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:05.116748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:05.119303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:05.124573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:05.126046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:05.126843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:05.128449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:05.182119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:05.191154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:05.211986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=8 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:05.237712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:05.252248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:05.253325 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:05.256273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:05.256533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:05.257046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:05.537460 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:05.565174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:05.569207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:05.579518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c98f3199-da81-4bf1-9216-0683eca2229b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.490486 Sep 23 01:33:05.581464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 200/402] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:05 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:05.940701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:05.969229 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d99e9018-5e87-439a-8fee-03af2470778a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.795444 Sep 23 01:33:05.971981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 203/403] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:05 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:06.132951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc33819d-e38f-4ea1-a2d1-73114ecd1d24", "tag": "fb614e28-a267-44d0-959d-688089a8d704"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:06.171063 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:06.172128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:06.172937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:06.200714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] Creating event network-changed:fb614e28-a267-44d0-959d-688089a8d704 for instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 on hv-cinder-84914 Sep 23 01:33:06.216356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-da5ff3b4-29e5-435b-bdf5-7712ae3d6ec4 req-ccb717cc-7b7c-44ed-a57e-15925d1658a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103958 Sep 23 01:33:06.217127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 201/404] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:33:06.625933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:06.626906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:06.636538 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:06.637536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:06.638401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:06.639585 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:06.640359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:06.641085 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:06.908407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:06.925881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:06.929131 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:06.931484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b3ffc21f-d803-4f8e-9738-d9ffd52ba8e3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.311788 Sep 23 01:33:06.932539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 204/405] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:06 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:07.018083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:07.019435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:07.030277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:07.030792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:07.031250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:07.032038 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:07.032509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:07.032942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:07.330835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:07.347891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f54bba23-4313-4d88-bd6c-a32944090097 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.337439 Sep 23 01:33:07.350377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 202/406] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:07 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:07.984737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:07.985953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:07.999908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:08.106391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:08.106391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:08.106391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:08.106391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:08.107220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:08.107220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:08.316973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:08.350502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:08.360840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:08.363421 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-051f937c-d7ac-4c56-b0d2-678f268f0677 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.386833 Sep 23 01:33:08.382285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 205/407] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:07 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:08.400295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:08.403253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:08.413885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:08.414641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:08.415244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:08.416106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:08.416836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:08.417418 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:08.682078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:08.698832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ba1728e0-066a-4e65-acab-1b12766a0451 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.305788 Sep 23 01:33:08.702823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 203/408] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:08 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:09.421017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:09.423209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:09.443273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:09.444365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:09.445926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:09.447783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:09.449004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:09.450145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:09.765569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:09.772709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:09.797298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:09.800810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:09.804666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:09.805855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:09.806663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:09.810538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:09.855642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:09.869288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:09.883099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:09.888904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-12c86804-fc08-43bb-873c-ad66e684cf57 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1754 microversion: 2.20 time: 0.479165 Sep 23 01:33:09.916789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 206/409] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:09 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1754 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:10.250564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:10.272576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2f4fd7a3-4387-4951-b7dc-980916960b5b tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.533710 Sep 23 01:33:10.274461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 204/410] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:09 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:10.941383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:10.950338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:10.951918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:10.953401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:10.954495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:10.955837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:10.956873 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:10.957562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:11.328159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:11.331416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:11.345821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:11.347477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:11.351718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:11.351718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:11.351718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:11.351718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:11.367474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:11.386084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:11.395741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:11.395741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9962b5d6-6fc5-4ac8-8a02-ce72e8a53c2c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.456017 Sep 23 01:33:11.395741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 207/411] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:10 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:11.896437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:11.912533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-def1911d-e60d-438f-9ba5-ba551b2bb623 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.600246 Sep 23 01:33:11.913961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 205/412] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:11 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:12.456290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:12.459690 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:12.475906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:12.477258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:12.478188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:12.479819 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:12.482094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:12.484237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:12.738217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:12.755491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:12.757853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:12.759496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-675e751f-c02f-40a7-870d-aa5375732d05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.317797 Sep 23 01:33:12.760354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 208/413] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:12 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:12.956605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:12.959068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:12.970878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:12.971387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:12.971873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:12.972608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:12.973146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:12.973513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:13.172052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:13.183850 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0d085488-f5ae-4bb4-aa6d-02f2a78970d6 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.234902 Sep 23 01:33:13.184923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 206/414] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:12 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:13.802786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:13.804155 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:13.814826 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:13.815325 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:13.815790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:13.816782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:13.817280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:13.817720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:14.014884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:14.027700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:14.030000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:14.031455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-692d6eb7-7ec5-4f22-89e2-e211c150de63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.233594 Sep 23 01:33:14.032133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 209/415] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:13 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:14.221620 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:14.222937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:14.231227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:14.232055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:14.232286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:14.232996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:14.233595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:14.234120 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:14.488775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:14.499993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-451c290e-6018-40e3-9c39-bdf1c5ac4c1c tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.282789 Sep 23 01:33:14.501431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 207/416] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:14 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:15.074854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:15.076254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:15.100985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:15.100985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:15.100985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:15.100985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:15.101527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:15.101527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:15.304215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:15.319207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:15.321916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:15.323778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-db2bd870-e8ad-41c9-b9b3-3ee7a3586563 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.256841 Sep 23 01:33:15.324382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 210/417] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:15 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:15.531504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:15.532638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:15.540423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:15.541879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:15.541879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:15.542428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:15.543767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:15.544438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:15.794798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:15.808174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9518fade-ad18-4531-97c2-2d8c8a0fe399 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.280882 Sep 23 01:33:15.809200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 208/418] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:15 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:16.380032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:16.382821 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:16.419108 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:16.420183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:16.421041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:16.422729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:16.423711 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:16.426026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:16.705915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:16.731360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:16.734768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:16.736980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0ecbdd16-e6d3-4ccb-b692-e9a3c6cb6ec5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.372119 Sep 23 01:33:16.738576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 211/419] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:16 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:16.857638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:16.859099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:16.895167 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:16.895928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:16.896217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:16.896750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:16.902590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:16.903387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:17.195730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:17.219643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-311b6998-597d-4b42-980f-61b162d01844 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.375877 Sep 23 01:33:17.248223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 209/420] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:16 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:17.780359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:17.786854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:17.812402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:17.816608 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:17.817668 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:17.822572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:17.823411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:17.824169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:18.141032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:18.159273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:18.167592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:18.169304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f7fb9f32-c161-40bf-bc76-bf7029c87138 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.398642 Sep 23 01:33:18.170426 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 212/421] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:17 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:18.256402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:18.257787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:18.274463 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:18.275271 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:18.276007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:18.277265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:18.277971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:18.278703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:18.676942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:18.697746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:18.707906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ca6c7f68-df0c-4fb6-9691-4cd222edce01 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.453705 Sep 23 01:33:18.716298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 210/422] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:18 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:19.214191 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:19.215955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:19.228510 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:19.231936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:19.232748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:19.233753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:19.236868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:19.237647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:19.703209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:19.737573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:19.756107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:19.761427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:19.763741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:19.768059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-92c74e5b-c32b-49e9-90d9-be047132aec9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.558191 Sep 23 01:33:19.780342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 213/423] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:19 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:19.794127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:19.803000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:19.804251 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:19.805860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:19.809760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:19.813318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:20.220120 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:20.235174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-06d2f95c-6499-4868-8441-cbda59acb831 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.493444 Sep 23 01:33:20.236318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 211/424] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:19 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:20.846337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:20.849527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:20.857256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:20.871289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:20.874243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:20.875773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:20.877676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:20.878463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:20.879157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:21.249849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:21.281502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:21.282549 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:21.294020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:21.302301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:21.309847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:21.311347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7ee8315a-ca83-44ff-b8ec-6533fda304ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.492837 Sep 23 01:33:21.313010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:21.313542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 214/425] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:20 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:21.335226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:21.344458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:21.344458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:21.344458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:21.534680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:21.546042 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f1bb3df3-cc90-4459-b9f1-c166aae6b2d3 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.272803 Sep 23 01:33:21.563579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 212/426] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:21 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:22.350220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:22.351976 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:22.366990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:33:22.369110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Fri Sep 23 01:33:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d (ip 10.222.0.64) !!! Sep 23 01:33:22.387244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:22.390810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:22.394379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:22.396476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:22.397192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:22.399396 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:22.575605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:22.597572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:22.652019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:22.655597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:22.656367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:22.657762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:22.658641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:22.675371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:22.921938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:23.021205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:23.023693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:23.025353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d41538c8-f473-422d-90d3-d823619ca8cd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.683710 Sep 23 01:33:23.040377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 215/427] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:22 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:23.284938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:23.306550 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-80c0cba9-adb6-43f2-b606-f360b42db16a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.738351 Sep 23 01:33:23.332838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 213/428] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:22 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:23.968742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc33819d-e38f-4ea1-a2d1-73114ecd1d24", "name": "network-vif-plugged", "status": "completed", "tag": "fb614e28-a267-44d0-959d-688089a8d704"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:23.997698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:23.998619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:23.999525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:24.024804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] Creating event network-vif-plugged:fb614e28-a267-44d0-959d-688089a8d704 for instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 on hv-cinder-84914 Sep 23 01:33:24.047579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-64c7c8c2-16e6-4bc0-b754-6260a780bb46 req-9079ef1d-21bf-4ef5-8960-9e9345c27789 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091576 Sep 23 01:33:24.053117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 216/429] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:33:24.061617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:24.062714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:24.095161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:24.102697 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:24.108449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:24.109711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:24.111348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:24.112959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:24.339075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:24.342458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:24.386188 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:24.388467 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:24.389379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:24.392768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:24.393819 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:24.400436 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:24.556967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:24.580266 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:24.585432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:24.592580 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-afb96060-df9b-4317-bdc0-d8f8d8010311 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.537732 Sep 23 01:33:24.594120 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 214/430] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:24 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:24.740400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:24.766892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1711c02f-e232-455a-89bf-a57203b0c072 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.433638 Sep 23 01:33:24.767496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 217/431] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:24 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:25.634608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:25.640124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:25.663307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:25.666248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:25.667375 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:25.670172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:25.672927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:25.675571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:25.841086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:25.843015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:25.857385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:25.858251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:25.863297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:25.873349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:25.874340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:25.876185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:26.048378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:26.095158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:26.107997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:26.123260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-065319c7-8e0e-4eb3-b68e-cc6438e17f8a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.495298 Sep 23 01:33:26.132441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 215/432] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:25 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:26.307154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:26.356889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-20db1b72-b8d7-42bd-94b8-233a9dc1c19d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.535004 Sep 23 01:33:26.359452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 218/433] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:25 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:27.177724 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:27.179976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:27.192230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.193301 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.193885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.194977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.196639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.198144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.415154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:27.417105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:27.418514 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:27.426505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:27.428280 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:27.429830 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bbb33069-6d96-4b25-bf33-d6d79c1cb629 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.268397 Sep 23 01:33:27.430846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 216/434] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:27 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:27.431118 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.432089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.432924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.434393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.435344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.436304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.626218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:27.627087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:27.637006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.637911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.638759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.639980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:27.640905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:27.641941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:27.654264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:27.669572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fdbf0927-7a19-4447-9ef3-da7c39999056 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.267089 Sep 23 01:33:27.670847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 219/435] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:27 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:27.858772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lazy-loading 'services' on Instance uuid 2797dc79-1fc8-447f-865e-401bc4353e75 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:28.233311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-83c33208-88a7-416e-a424-0cb6663d9056 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75/os-volume_attachments/5aa410a6-669b-4ecc-959c-937439c37e79" status: 202 len: 0 microversion: 2.1 time: 0.614523 Sep 23 01:33:28.236445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 217/436] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:33:27 2022] DELETE /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75/os-volume_attachments/5aa410a6-669b-4ecc-959c-937439c37e79 => generated 0 bytes in 619 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:33:28.465909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:28.468551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:28.478938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:28.479307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:28.479983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:28.480939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:28.482298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:28.482811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:28.720313 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:28.722786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:28.740069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=48 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:28.746725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:28.748457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:28.752319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:28.752319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:28.752319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:28.754130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:28.811845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:28.839059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:28.844988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:28.857009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-78e36476-7a57-4a1c-931f-3fbe67aff118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.389026 Sep 23 01:33:28.872647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 220/437] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:28 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:29.025224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:29.047726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-856cd4ad-af7f-4617-89b9-7f01e9e8d95d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.339041 Sep 23 01:33:29.049206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 218/438] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:28 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:29.899186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:29.900762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:29.917032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:29.918676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:29.919864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:29.922065 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:29.922993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:29.924117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:30.094227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:30.096197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:30.123994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:30.127656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:30.128102 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:30.128933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:30.129654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:30.129871 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:30.184044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:30.209021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:30.210500 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:30.211847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5db77673-7796-4443-b33b-ad42d08a0c63 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.323940 Sep 23 01:33:30.212799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 221/439] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:29 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:30.381866 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:30.398341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-98ce113c-133c-4a1c-b79f-df79241dc486 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.317159 Sep 23 01:33:30.399152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 219/440] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:30 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:31.242249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:31.243472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:31.256067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:31.258278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:31.258278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:31.258662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:31.259215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:31.259879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:31.438747 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:31.439849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:31.451755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:31.452315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:31.453079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:31.459198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:31.459198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:31.459198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:31.499432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:31.513939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:31.521892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:31.526332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:31.531651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff5f3899-48a6-4eff-a908-7ce377786964 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.293076 Sep 23 01:33:31.539954 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 222/441] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:31 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:31.713633 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:31.732387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-edd40ee6-56ea-4dcb-8f5a-04f4c7b094d1 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1315 microversion: 2.1 time: 0.298943 Sep 23 01:33:31.733927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 220/442] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:31 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1315 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:32.581816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:32.582823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:32.596232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:32.596736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:32.597198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:32.598002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:32.598781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:32.599414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:32.760440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:32.761050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:32.769216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:32.770556 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:32.772055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:32.772889 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:32.773465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:32.773906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:32.813090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:32.845797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:32.850974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:32.855369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a7bf69ad-6630-4c0a-bb9c-1c166ec2922d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.280087 Sep 23 01:33:32.857123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 223/443] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:32 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:33.035462 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:33.047435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a806d004-db8a-4176-917c-6023989abd33 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1464 microversion: 2.1 time: 0.290976 Sep 23 01:33:33.048205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 221/444] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:32 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1464 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:33.105502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:33.106084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:33.114255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:33.115025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:33.115629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:33.116583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:33.117150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:33.117642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:33.151814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:33:33.933343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:33.933343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:33.938795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:33.941161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:33.942179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:33.943239 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:33.943860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:33.944530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:34.125119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4d6bd6d7-7d30-486b-84e9-6845bd3c36ba tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 204 len: 0 microversion: 2.1 time: 1.015914 Sep 23 01:33:34.126224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 224/445] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:33:33 2022] DELETE /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 0 bytes in 1026 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:33:34.140673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:34.142132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:34.154160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:34.154823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:34.155696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:34.157029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:34.157861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:34.158596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:34.172820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:34.191972 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:34.195828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:34.198567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-553bd603-f56f-4d44-bf50-be198eede3a3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.285839 Sep 23 01:33:34.199575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 222/446] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:33 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:34.424799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:34.438746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-30f0212f-e533-4fa3-a3be-f65132ea40c9 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1470 microversion: 2.1 time: 0.304387 Sep 23 01:33:34.439875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 225/447] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:34 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:35.238744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:35.240116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:35.252190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:35.253479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:35.254462 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:35.255596 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:35.256136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:35.256700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:35.446147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:35.465393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:35.467223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:35.468723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fc68e6f6-7528-476c-a4eb-f91635091f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.236112 Sep 23 01:33:35.469297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 223/448] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:35 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:35.470773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:35.472069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:35.485991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:35.495213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:35.495213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:35.495213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:35.495213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:35.498132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:35.724725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:35.738246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-94a23da0-a543-49e0-ae7d-cc12d4aa8231 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1470 microversion: 2.1 time: 0.275514 Sep 23 01:33:35.739238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 226/449] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:35 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:36.507114 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:36.509212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:36.520440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:36.521345 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:36.522427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:36.523230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:36.523726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:36.524158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:36.736906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:36.750218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:36.752806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:36.754557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-92033da8-e828-4718-97fa-d0a8b72ec760 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.254655 Sep 23 01:33:36.755164 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 224/450] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:36 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:36.773773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:36.773773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:36.784410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:36.785480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:36.786210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:36.787592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:36.788298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:36.789198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.136192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:37.161649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e226395e-7a7c-41c2-8cf3-9836ca927b6a tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1470 microversion: 2.1 time: 0.398945 Sep 23 01:33:37.162707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 227/451] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:36 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:37.328300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:37.330873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:37.348095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:37.356119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:37.356119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.356119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:37.356119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:37.358756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.431163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:33:37.489443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:37.574371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc33819d-e38f-4ea1-a2d1-73114ecd1d24", "name": "network-vif-deleted", "tag": "fb614e28-a267-44d0-959d-688089a8d704"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:37.576357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:37.577179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:37.577915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.597778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] Creating event network-vif-deleted:fb614e28-a267-44d0-959d-688089a8d704 for instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 on hv-cinder-84914 Sep 23 01:33:37.607172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-bca4a74f-beeb-47c1-b900-ba1ccf8b17a2 req-28144b0a-ee26-4d92-8ec0-df8e114e27a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069255 Sep 23 01:33:37.608592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 228/452] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:33:37.680643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:37.681433 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:37.690260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:37.690768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:37.691229 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.691974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:37.692423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:37.692850 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:37.896513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'services' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:38.037099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b2db1124-afd8-40fd-b39f-284c6eaabb6d tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 204 len: 0 microversion: 2.1 time: 0.712024 Sep 23 01:33:38.037099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 225/453] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:33:37 2022] DELETE /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:33:38.040457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:38.041158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:38.055209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.055209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.055209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.055209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.055891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.055891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.253195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:38.263242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:38.264809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:38.266010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-045ff095-556b-460a-ac88-c3247f09ec05 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.230819 Sep 23 01:33:38.266563 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 226/454] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:38 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:38.271243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:38.273240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:38.280387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.280982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.281477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.282289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.282842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.283263 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.437707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:38.448342 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6ac59324-da14-4c4c-a43f-0cd1ba1370e0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1512 microversion: 2.1 time: 0.180665 Sep 23 01:33:38.461067 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 227/455] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:38 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:38.462571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:38.463489 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:38.475340 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.476054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.476748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.477716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.478555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.479088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.527908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:38.528588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:38.529034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:38.529498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lazy-loading 'fault' on Instance uuid fc33819d-e38f-4ea1-a2d1-73114ecd1d24 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:38.596086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:38.618054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0502f098-58f9-4673-bfce-617507951e7e tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1305 microversion: 2.1 time: 0.157134 Sep 23 01:33:38.618054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 228/456] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:38 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1305 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:38.813066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-55ca23cc-5eae-49e9-a9ce-4e5f2d9d319e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments/5e525899-4342-4446-ac9a-37b0f9e92315" status: 202 len: 0 microversion: 2.1 time: 1.136313 Sep 23 01:33:38.894722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 229/457] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:33:37 2022] DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments/5e525899-4342-4446-ac9a-37b0f9e92315 => generated 0 bytes in 1138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:33:39.307842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:39.309217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:39.315287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.315831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.316279 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.316974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.317634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.318061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.498201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:39.499319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:39.503286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:39.507349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.507910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.508906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.509201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.509629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.510016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.523804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:39.530182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:39.530182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5a6271c0-9ad4-4a5b-948a-fc92fc04e454 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.226269 Sep 23 01:33:39.531199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 229/458] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:39 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:39.653733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:39.655186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:39.669016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.669543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.670181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.671436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.672394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.672934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.722295 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:39.725176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:39.725659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:39.726294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:39.726941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lazy-loading 'fault' on Instance uuid fc33819d-e38f-4ea1-a2d1-73114ecd1d24 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:39.738115 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2af08b3e-893f-489e-83c9-ddb78e5a00b0 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1512 microversion: 2.1 time: 0.253226 Sep 23 01:33:39.742853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 230/459] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:39 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:39.776463 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:39.787778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f2cd043a-5602-4236-8e12-a0f5a8d36869 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1305 microversion: 2.1 time: 0.140864 Sep 23 01:33:39.788278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 230/460] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:39 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:40.572448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:40.573705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:40.588699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.589987 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.590898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.592557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.594052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.595064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.772359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:40.774702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:40.785070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.786066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.786666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.788136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.788471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.788932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.795969 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:40.806763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:40.811123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:40.813672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-cd0af9fe-560d-4054-8e8a-757db75c09b1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.249102 Sep 23 01:33:40.828727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 231/461] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:40 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:40.850465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:40.851285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:40.860142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.860663 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.861243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.861983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.862445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.862914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.904315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:40.904951 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:40.905413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:40.905960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lazy-loading 'fault' on Instance uuid fc33819d-e38f-4ea1-a2d1-73114ecd1d24 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:40.973893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:40.982752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f1eb3c68-1554-4f7f-b0ca-84d9e08d4061 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1305 microversion: 2.1 time: 0.153199 Sep 23 01:33:40.983722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 232/462] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:40 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1305 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:41.022306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:41.030621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-96673182-ec93-4cab-8661-4065e0a40a9e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1512 microversion: 2.1 time: 0.266543 Sep 23 01:33:41.031206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 231/463] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:40 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:41.854460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:41.856181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:41.863754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:41.864664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:41.865361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:41.866399 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:41.867116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:41.867676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.011138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:42.012910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:42.028290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.029780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.031338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.034818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.035905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.036812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.099244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.100006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.100702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.101201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lazy-loading 'fault' on Instance uuid fc33819d-e38f-4ea1-a2d1-73114ecd1d24 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:42.117632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:42.158609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:42.160221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:42.161486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d2cf2964-6cd1-416a-bba7-8c109d9b1118 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.311687 Sep 23 01:33:42.177864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 233/464] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:41 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:42.190619 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:42.191728 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:42.194401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:42.226980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2402f9ba-eb0c-4b1e-a5c1-c2056281629f tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1305 microversion: 2.1 time: 0.223691 Sep 23 01:33:42.228588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 232/465] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:42 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1305 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:42.237302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.238294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.239053 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.240316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.241207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.241833 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.405512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2797dc79-1fc8-447f-865e-401bc4353e75", "name": "network-vif-deleted", "tag": "a06eccad-6dd8-455b-a742-fada65ca5091"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:42.407627 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:42.418345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0e0eec80-e69a-46f0-9007-2c258febab75 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1470 microversion: 2.1 time: 0.238601 Sep 23 01:33:42.419110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 234/466] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:42 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:42.422923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:42.423809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:42.424610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:42.449561 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] Creating event network-vif-deleted:a06eccad-6dd8-455b-a742-fada65ca5091 for instance 2797dc79-1fc8-447f-865e-401bc4353e75 on hv-cinder-84914 Sep 23 01:33:42.457959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-90056ce3-0866-4045-a7fa-2a8eae3f44e1 req-3a1eb770-5bf0-47aa-baaa-889deb62f1e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056917 Sep 23 01:33:42.458802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 233/467] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:33:43.196622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:43.197441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:43.206138 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.206865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.208006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.208673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.209389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.209950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.258541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:43.259773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:43.286750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.287658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.288430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.289652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.290539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.291276 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.373551 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.374715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.376611 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.377700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lazy-loading 'fault' on Instance uuid fc33819d-e38f-4ea1-a2d1-73114ecd1d24 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:43.441630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:43.464708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:43.469964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:43.472745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-89092c49-d11a-428d-b617-67f776ce58e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.281819 Sep 23 01:33:43.481656 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 235/468] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:43 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:43.481985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69e81cfb7aa24918b5ec8b32064e17eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84a9bb6a15444802af12e048ea53223d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:43.495226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:43.505787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a005610e-6614-461d-816c-d068eb386e47 tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 200 len: 1305 microversion: 2.1 time: 0.253510 Sep 23 01:33:43.507204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 234/469] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:43 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 1305 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:43.511271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.512431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.514243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.518013 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:43.519725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:43.532614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.533858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.535115 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.536988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.538300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.539356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.603258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:43.603258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:43.603741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:43.604180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lazy-loading 'fault' on Instance uuid 2797dc79-1fc8-447f-865e-401bc4353e75 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:33:43.666008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Going to try to stop instance {{(pid=121762) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 23 01:33:43.674025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:43.688049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4c1bd299-3e9e-43d9-8cd2-88992540dfc8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 200 len: 1307 microversion: 2.1 time: 0.178640 Sep 23 01:33:43.689877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 235/470] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:43 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 1307 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:43.717347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:43.990937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9aeacf4f-5941-4fbf-a475-cdfb00877b17"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:43.995314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:44.008322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.009590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.010714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.010879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4620e7c5-35c3-4673-bb58-f05997ea41e7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action" status: 202 len: 0 microversion: 2.1 time: 0.525635 Sep 23 01:33:44.011894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 236/471] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:33:43 2022] POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:33:44.012032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.012642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.013363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.024450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:44.024450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:44.035308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.041589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.041589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.041589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.041589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.041993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.256199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:44.272123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4be649ba-5639-4627-8302-817e927bd6db tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.252745 Sep 23 01:33:44.273220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 237/472] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:44 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:44.523898 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:44.524409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:44.629679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.630449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.630900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.631872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.632496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.633225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.832959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:44.851621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:44.853367 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:44.854708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d6ab0c93-8105-4ac3-9c7b-bef544ab6c84 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.335072 Sep 23 01:33:44.872659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 238/473] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:44 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:44.878380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:44.879294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] [instance: fc33819d-e38f-4ea1-a2d1-73114ecd1d24] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:44.903729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.904228 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.904701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.905775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.906264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.906891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.929503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] HTTP exception thrown: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Request method failure captured: Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 HTTP/1.1 Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQzB8YvBLoNkTWE8_0t1n2b1_dIBNVYY5jb4azZhbNbuCfcKKWL8quqdeZUZrDsB8Zy9h6nnl1rzR7kY2yFn3dVDyZAQ2HtxsZuQCIAbl_B5I0PQeUjfr0Oeqc6-dyrSq6l0CVFarPpFWRhhxtJwHKTTI2ECAik5SXEOuDGKY8c9-fU Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 84a9bb6a15444802af12e048ea53223d Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesNegativeTest-1811338709 Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:33:44.931407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84a9bb6a15444802af12e048ea53223d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/84a9bb6a15444802af12e048ea53223d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/84a9bb6a15444802af12e048ea53223d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_84a9bb6a15444802af12e048ea53223d", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesNegativeTest-1811338709 Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 84a9bb6a15444802af12e048ea53223d Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesNegativeTest-1811338709 Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesNegativeTest-1811338709-project Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 69e81cfb7aa24918b5ec8b32064e17eb Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesNegativeTest-1811338709-project Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. Sep 23 01:33:44.934425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'fc33819d-e38f-4ea1-a2d1-73114ecd1d24'} Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:33:44.936107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. Sep 23 01:33:44.939176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:44.942224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] Returning 404 to user: Instance fc33819d-e38f-4ea1-a2d1-73114ecd1d24 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:33:44.942224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-cc4e5b50-6cde-4807-a3f5-55e33ad45a0d tempest-VolumesNegativeTest-1811338709 tempest-VolumesNegativeTest-1811338709-project] 10.222.0.64 "GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24" status: 404 len: 111 microversion: 2.1 time: 0.065101 Sep 23 01:33:44.942224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 239/474] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:44 2022] GET /compute/v2.1/servers/fc33819d-e38f-4ea1-a2d1-73114ecd1d24 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:33:44.955525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:44.957324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 2797dc79-1fc8-447f-865e-401bc4353e75] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:44.981959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.981959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.981959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.981959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:44.983276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:44.983276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:44.997884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] HTTP exception thrown: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Request method failure captured: Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 HTTP/1.1 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQyOisqcKySX08SKehwWXSvSwmwjlxFJqE1SxoUNH6Zh70SzgGPStCDPj_mQ6lLz8QFR1bvz-Ff992yPhTZ-XaAtzBvGJzdVKSx816xXAYSsaDd-Pni685KHx_zWaSPPomMf1M4gPYipUEcBmPDq_zKoESj0cEiJLOUErvOVIvbWTEQ Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 95935852764e413c8bbd23c16ddf13a5 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:33:44.999518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_95935852764e413c8bbd23c16ddf13a5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 95935852764e413c8bbd23c16ddf13a5 Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesSnapshotTestJSON-1834860145-project Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: c8982a7c52314c5a82d80a03d9a833d6 Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesSnapshotTestJSON-1834860145-project Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. Sep 23 01:33:45.002315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '2797dc79-1fc8-447f-865e-401bc4353e75'} Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:33:45.004154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. Sep 23 01:33:45.007152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:33:45.008930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Returning 404 to user: Instance 2797dc79-1fc8-447f-865e-401bc4353e75 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:33:45.008930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2bb922fb-eac9-4966-ba83-eeb6072212b4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75" status: 404 len: 111 microversion: 2.1 time: 0.059979 Sep 23 01:33:45.008930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 240/475] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:44 2022] GET /compute/v2.1/servers/2797dc79-1fc8-447f-865e-401bc4353e75 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:33:45.299977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:45.300793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:45.310186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:45.310759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:45.311624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:45.314836 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:45.314836 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:45.314836 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:45.580308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:45.604562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-04a12ec0-5ec8-44f9-8b99-12bccd740859 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.308668 Sep 23 01:33:45.605819 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 241/476] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:45 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:45.643086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d6c50f99-cf84-46bd-898f-d1fb40567e64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.658768 Sep 23 01:33:45.644191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 236/477] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:33:43 2022] POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments => generated 194 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:33:45.888492 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:45.889361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:45.896062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:45.896648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:45.897094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:45.897802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:45.898256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:45.898672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:46.086107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:46.096929 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:46.098445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:46.100039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-65cbca23-8db8-4fd6-ab26-8cc6887313f5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.216210 Sep 23 01:33:46.100643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 242/478] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:45 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:46.648378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:46.649151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:46.657411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:46.657869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:46.658885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:46.659897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:46.660361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:46.660780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:46.897470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:46.910970 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b8151d72-42b2-478a-b127-049a7f35ce3d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.267890 Sep 23 01:33:46.911636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 237/479] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:46 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:47.148828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:47.149612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:47.157265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:47.157781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:47.158363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:47.159058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:47.159579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:47.160000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:47.350903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:47.361017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:47.362266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:47.363544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-10380bae-2ac3-45ef-825b-9f88956c9c00 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.221849 Sep 23 01:33:47.364168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 243/480] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:47 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:47.939485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:47.940201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:47.950804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:47.951468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:47.952187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:47.953169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:47.953648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:47.954077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:48.137356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:48.151452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-41e110c9-7bb1-412a-a943-5928fb8189b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.216061 Sep 23 01:33:48.152037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 238/481] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:47 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:48.393969 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:48.393969 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:48.398692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:48.399173 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:48.399642 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:48.400348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:48.400797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:48.401345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:48.555270 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:48.564696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:48.566146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:48.567380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-370699af-bb38-4774-9b89-32281f96b747 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.180305 Sep 23 01:33:48.567968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 244/482] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:48 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:49.182954 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:49.184538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:49.196210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:49.197194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:49.197909 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:49.199787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:49.200620 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:49.201135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:49.228710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:49.416181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:49.416181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8b83e480-d90b-4e92-b14a-d067fabd2c67 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.231814 Sep 23 01:33:49.416181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 239/483] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:49 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:49.594225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:49.594784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:49.602673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:49.603164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:49.603632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:49.604348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:49.604799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:49.605730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:49.781105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:49.790928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:49.793984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:49.795469 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fc176810-c808-4e98-9591-ee7d26d095f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.205819 Sep 23 01:33:49.796789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 245/484] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:49 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:49.902905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "name": "network-vif-plugged", "status": "completed", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:49.919292 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:49.919863 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:49.920354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:49.936661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] Creating event network-vif-plugged:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:33:49.945338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-dc7e75a1-0c1f-455f-8573-d9626d9efa02 req-9884e724-6e9e-45c7-8658-bf9a3f721215 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048119 Sep 23 01:33:49.946341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 240/485] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:33:50.439177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:50.440581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:50.453175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:50.454077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:50.454894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:50.456302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:50.457212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:50.458016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:50.684293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:50.694160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ddcee178-64c5-48f0-a6de-3c34786dcaed tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.261691 Sep 23 01:33:50.694765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 246/486] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:50 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:50.837325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:50.838253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:50.849614 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:50.850775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:50.851443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:50.852772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:50.853504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:50.854179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:51.036810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:51.054004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:51.055672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:51.056960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-89d12833-23b6-4bf7-b388-db6a0c91905b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.227388 Sep 23 01:33:51.057559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 241/487] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:50 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:51.724478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:51.725524 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:51.734031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:51.734814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:51.735538 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:51.736866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:51.737692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:51.738486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:51.907868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:51.916841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-08dadde3-2972-4f1f-a017-9710bb5afd8a tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.199584 Sep 23 01:33:51.917944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 247/488] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:51 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:52.102114 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:52.103112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:52.116316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:52.117245 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:52.118069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:52.119399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:52.120302 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:52.121716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:52.333411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:52.344369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:52.345902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:52.347124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-db300854-d9ed-4d68-833d-fd86cada9272 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.252310 Sep 23 01:33:52.347730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 242/489] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:52 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:52.942888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:52.943470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:52.946283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:52.951950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:52.952448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:52.952890 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:52.953644 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:52.954123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:52.954557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:53.144035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:53.153525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-122094fd-81c1-4e59-b9b1-8f58f2b3ba73 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.215008 Sep 23 01:33:53.154193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 248/490] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:52 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:53.377761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:53.378534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:53.386039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:53.394278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:53.394278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:53.394278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:53.394278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:53.394639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:53.602287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:53.612681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:53.614214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:53.615473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-df97c348-f61c-43b1-bc41-f552f6e3fd7a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.242704 Sep 23 01:33:53.616082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 243/491] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:53 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:54.183941 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:54.186659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:54.215726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:54.216558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:54.217250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:54.217978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:54.218799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:54.219263 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:54.408523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:54.435464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-121715a6-cde9-495c-a091-209328b78719 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.258254 Sep 23 01:33:54.441187 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 249/492] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:54 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:54.644272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:54.644913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:54.651939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:54.652456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:54.652901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:54.653628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:54.654162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:54.654589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:54.819264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:54.833088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:54.834581 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:54.835918 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-acfa60d3-9279-45ba-baf6-58092c86b389 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.195938 Sep 23 01:33:54.839700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 244/493] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:54 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:55.461769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:55.462814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:55.472951 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:55.473518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:55.473965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:55.477736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:55.477736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:55.477736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:55.674496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:55.684158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-677349e4-213c-4972-87c2-b054fa68e39f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.226891 Sep 23 01:33:55.684847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 250/494] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:55 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:55.862989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:55.863881 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:55.871856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:55.872354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:55.872860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:55.873585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:55.874044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:55.874477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:56.020747 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:56.029762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:56.031204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:56.032405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bf2384a9-fda3-48d0-aa83-03eff43e8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.173821 Sep 23 01:33:56.032967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 245/495] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:55 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:56.713566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:56.714762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:56.722550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:56.723045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:56.723479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:56.724231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:56.724680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:56.725130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:56.883183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:56.892313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-561bee59-73c5-4e24-9ab2-19249305c53e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.184194 Sep 23 01:33:56.892924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 251/496] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:56 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:57.060009 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:57.061132 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:57.072651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:57.073314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:57.074528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:57.075845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:57.076037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:57.076561 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:57.254403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:57.268963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:57.272521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:57.274947 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0b88d90-3a80-4334-9f4b-b19fb4bba66a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.219828 Sep 23 01:33:57.275987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 246/497] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:57 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:33:57.918615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:57.919360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:57.926538 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:57.927140 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:57.927602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:57.928345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:57.928803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:57.929257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:58.090422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:58.101329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7ff40b94-868a-4883-a70b-d267d68493be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.187700 Sep 23 01:33:58.102477 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 252/498] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:57 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:58.305834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:58.306689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:58.318195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:58.320985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:58.320985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:58.321376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:58.322204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:58.323191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:58.436910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1208550863", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "networks": [{"uuid": "2e07beaf-fde3-41c4-b32f-8b8bdfbb8f05"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:33:58.533689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:58.542322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:58.544321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:58.544861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] validate_networks() for [('2e07beaf-fde3-41c4-b32f-8b8bdfbb8f05', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:33:58.545699 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7a97fed5-4334-4af6-b65f-37c742fa7951 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.246605 Sep 23 01:33:58.546497 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 247/499] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:58 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:33:59.108739 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:33:59.109352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:33:59.109666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:33:59.110146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:33:59.110612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:33:59.124517 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.125151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.125705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:59.126737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.127253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.127865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:59.129255 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:59.130003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:59.132467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:33:59.139386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.140060 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.140709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:59.141730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.142308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.142867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:59.153187 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Getting quotas for project 95935852764e413c8bbd23c16ddf13a5. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:33:59.159539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Getting quotas for user c8982a7c52314c5a82d80a03d9a833d6 and project 95935852764e413c8bbd23c16ddf13a5. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:33:59.174555 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:33:59.177338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:33:59.317336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:59.326970 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-447d6203-8ec4-48d6-a053-7ef530c4e492 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.203072 Sep 23 01:33:59.327983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 248/500] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:59 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:33:59.335620 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8114454c-4495-4414-809f-bc310bfc26e5 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906193 Sep 23 01:33:59.339936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 253/501] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:33:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:33:59.350430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-917f7f71-6e75-4721-9b2a-b868d48f8b03 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:59.351048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-917f7f71-6e75-4721-9b2a-b868d48f8b03 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:59.422960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-917f7f71-6e75-4721-9b2a-b868d48f8b03 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:33:59.432978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-917f7f71-6e75-4721-9b2a-b868d48f8b03 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1219 microversion: 2.1 time: 0.086435 Sep 23 01:33:59.434109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 249/502] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:33:59 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:33:59.576701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:33:59.577789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:33:59.589118 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.589908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.590599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:33:59.591783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:33:59.592536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:33:59.593271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:00.087350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:00.102915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:00.106257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:00.109549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-af64e0e3-681c-4f46-a7fe-22be88f22fa4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.539023 Sep 23 01:34:00.110740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 254/503] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:33:59 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:00.354297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:00.355141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:00.364613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:00.365177 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:00.365744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:00.366708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:00.367323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:00.368046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:00.469884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:00.470989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:00.482045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:00.482923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:00.489765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:00.489765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:00.489765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:00.489765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:00.494874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:00.543295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:00.552661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-28344a68-cb99-4c0a-a4f3-aa78dfed6952 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.203786 Sep 23 01:34:00.553252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 250/504] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:00 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:00.601510 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:00.610694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff623d97-2982-48db-acd1-2e84773c442e tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1223 microversion: 2.1 time: 0.148954 Sep 23 01:34:00.611382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 255/505] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:00 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1223 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:01.154360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:01.155626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:01.163894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.165285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.166092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.167249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.168929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.169479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.390975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:01.407423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:01.412329 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:01.414170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-af5d5909-1b1b-4005-aa49-a900a439d9ad tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.265061 Sep 23 01:34:01.415040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 251/506] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:01 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:01.585114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:01.586028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:01.595630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.596406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.597611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.598374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.598872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.599502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.636573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:01.637672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:01.646339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.647339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.648172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.649294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:01.649896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:01.650523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:01.742097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:01.752356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-09b60cd4-2eb7-4dbb-a10d-85b8c320a952 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1215 microversion: 2.1 time: 0.121000 Sep 23 01:34:01.753035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 252/507] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:01 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:01.791857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:01.804218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-03729acf-b9d1-4a49-b745-45c0bc8bf476 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.228888 Sep 23 01:34:01.805484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 256/508] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:01 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:02.447480 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:02.448991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:02.457457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.458056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.458507 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.459245 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.460824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.460824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.644169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:02.654083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:02.655592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:02.656861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8d5bfdfb-5536-4bef-8c10-ddd49f78f0f9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.217350 Sep 23 01:34:02.657492 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 253/509] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:02 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:02.784817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:02.785531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:02.794028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.794671 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.795543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.796244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.796710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.801410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.862909 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:02.864543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:02.879987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.880612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.881324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.882173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:02.882875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:02.883414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:02.938359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:02.950382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d2854b6a-dd68-4923-9bd0-ce877b63511b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1271 microversion: 2.1 time: 0.168091 Sep 23 01:34:02.958178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 257/510] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:02 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:03.084511 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:03.100538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8c76aca8-7e25-4c0d-bb31-de6f0b26295e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.264230 Sep 23 01:34:03.101151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 254/511] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:02 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:03.686790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:03.687471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:03.714790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:03.716689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:03.720011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:03.721732 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:03.723143 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:03.724079 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:03.920852 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:03.933894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:03.935848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:03.937555 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-19bd8983-ee31-44d0-8625-bfbe85117c9d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.256620 Sep 23 01:34:03.938364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 258/512] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:03 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:04.001104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:04.002348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:04.013341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.014122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.014656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:04.015797 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.016565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.017294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:04.110142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:04.123278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-85e14ad6-0746-4d6c-9916-db371ad4fafd tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1279 microversion: 2.1 time: 0.129885 Sep 23 01:34:04.124479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 255/513] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:03 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1279 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:04.133576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:04.134735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:04.146546 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.147430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.148248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:04.149541 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.150409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.151185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:04.345782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:04.354320 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e622bb21-1d5a-4af3-a0db-e4eef4de3001 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.228090 Sep 23 01:34:04.355199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 259/514] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:04 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:04.966572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:04.967226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:04.974128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.974599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.975028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:04.975773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:04.976216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:04.976638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:05.164752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:05.165744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:05.178327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:05.179000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:05.179766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:05.180539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:05.180710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:05.181590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:05.181905 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:05.199466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:05.201341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:05.202582 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-393a5e0c-40fc-4ace-993d-ad83dc453999 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.240781 Sep 23 01:34:05.203290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 256/515] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:04 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:34:05.269221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:05.280097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-abf95ad1-2a2e-4e9b-8c63-ee70f37934d9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1279 microversion: 2.1 time: 0.120574 Sep 23 01:34:05.281178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 260/516] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:05 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1279 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:05.389218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:05.397847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:05.397847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:05.397847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:05.398367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:05.399316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:05.399905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:05.400393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:05.652652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:05.655896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:05.664976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d695cef6-45f7-4448-8e7e-1619bbf96e79 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.281241 Sep 23 01:34:05.665722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 257/517] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:05 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:06.248739 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:06.250069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:06.257386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.257916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.258380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.259070 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.259523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.259977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.319508 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:06.321490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:06.331872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.335951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.335951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.335951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.335951 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.336605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.414794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:06.428094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b43d1623-d94c-4117-a24b-0e5da497ebf2 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1279 microversion: 2.1 time: 0.114686 Sep 23 01:34:06.429228 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 258/518] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:06 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:06.491986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:06.513277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:06.515142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:06.516398 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-49751726-19a5-4a50-9a08-bf63dd5b4584 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1810 microversion: 2.20 time: 0.272455 Sep 23 01:34:06.516961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 261/519] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:06 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1810 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:34:06.698073 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:06.698735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:06.705834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.706324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.706758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.707512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:06.708057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:06.708528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:06.874083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:06.883576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1c246ac7-e507-4598-91aa-4e8f798c97bb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1677 microversion: 2.1 time: 0.189500 Sep 23 01:34:06.884312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 259/520] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:06 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:07.453883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:07.454774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:07.467299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.467849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.468372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.469485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.469950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.470381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.571919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:07.574004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:07.588159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.589632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.590655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.592603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.594059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.595292 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.616051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:07.632611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-36ec153e-8d8c-46aa-9301-a17d8266fe1a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1277 microversion: 2.1 time: 0.182901 Sep 23 01:34:07.633687 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 262/521] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:07 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:07.913817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:07.914980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:07.938802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.942625 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.946075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.947742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:07.949463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:07.954301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:07.955032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:07.975209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:07.981750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:07.986801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a21e8692-51a1-4e9b-ac24-a232357c9996 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1797 microversion: 2.20 time: 0.422147 Sep 23 01:34:07.989209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 260/522] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:07 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1797 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:08.214588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:08.225473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-04d0f9b0-29c2-41c8-bd5e-be4f8f27b5da tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1654 microversion: 2.1 time: 0.318918 Sep 23 01:34:08.236694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 263/523] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:07 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1654 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:08.250727 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:08.258744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:08.262754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:08.262754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:08.289584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Going to try to start instance {{(pid=121763) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 23 01:34:08.614283 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f36cfd09-1a53-4358-97e8-42bfdd9e6d4f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action" status: 202 len: 0 microversion: 2.1 time: 0.367232 Sep 23 01:34:08.615533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 261/524] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:34:08 2022] POST /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/action => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:34:08.626224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:08.627324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:08.635996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:08.636579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:08.637099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:08.638225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:08.639353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:08.640792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:08.676085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:08.679103 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:08.688837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:08.689950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:08.690664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:08.691674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:08.692489 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:08.693216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:08.723194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'flavor' on Instance uuid f742ca8a-d7be-4ca0-9277-3a5a44421160 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:09.057148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:09.068928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-084302f8-0b5b-4d22-b7ab-1a5f77fae367 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1663 microversion: 2.1 time: 0.448740 Sep 23 01:34:09.070247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 264/525] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:08 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1663 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:09.076458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:09.077262 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:09.085429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:09.086716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:09.087667 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:09.088681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:09.090109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:09.090813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:09.146726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:09.170632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=6 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:09.290571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fa06b567-9b73-4cb6-95d1-4c1d1d12dad6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/action" status: 200 len: 32 microversion: 2.1 time: 0.621042 Sep 23 01:34:09.291076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 262/526] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:34:08 2022] POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/action => generated 32 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:34:09.304749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:09.305462 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:09.312534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:09.313290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:09.313730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:09.314454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:09.314902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:09.315423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:09.357666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:09.367172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-45b0163d-4800-4eae-8057-9e55f1d62cca tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.295482 Sep 23 01:34:09.368022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 265/527] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:09 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:09.437092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:09.502751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:09.519105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-916d1b26-fe54-44b5-b93d-b1a6e46a3b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.218553 Sep 23 01:34:09.519578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 263/528] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:09 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:10.008699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e8bde31-919a-498a-898a-c1a7fde0e80b", "tag": "8ef41830-75fb-4ad0-8285-a4080a6ebadc"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:10.022968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.023862 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.024486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.039858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] Creating event network-changed:8ef41830-75fb-4ad0-8285-a4080a6ebadc for instance 3e8bde31-919a-498a-898a-c1a7fde0e80b on hv-cinder-84914 Sep 23 01:34:10.045535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e047a293-c190-4650-b24b-fca7f271f62d req-7522a826-bb5f-47c6-98db-1a160da17f8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040871 Sep 23 01:34:10.046174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 266/529] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:10.107363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:10.108046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:10.115272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.115733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.116273 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.116996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.117447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.117865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.267268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:10.283038 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ac2abf5c-b23c-440c-83f0-a86e8da2ecc5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1663 microversion: 2.1 time: 0.180188 Sep 23 01:34:10.283666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 264/530] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:10 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1663 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:10.408237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:10.408935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:10.419247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.420388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.427827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.427827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.427827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.427827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.545260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:10.545887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:10.552677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.553158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.553587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.554293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:10.554744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:10.555170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:10.630793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:10.643468 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-99ff8ff4-a8a4-461f-b6ab-e28959ff78f9 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.237862 Sep 23 01:34:10.643468 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 267/531] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:10 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:10.738356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:10.748253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0845e04f-be79-4cb4-baca-22136751c6dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.207924 Sep 23 01:34:10.748850 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 265/532] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:10 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:11.308415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:11.309329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:11.318307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.318980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.319688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.320552 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.321058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.321496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.512877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:11.521606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dc8df869-e0f8-4aff-a463-c00161cd20f8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1663 microversion: 2.1 time: 0.218646 Sep 23 01:34:11.522212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 268/533] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:11 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1663 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:11.681720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:11.682428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:11.690061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.690629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.691194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.692021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.692467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.692894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.776347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:11.777509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:11.790109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.790109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.790812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.794162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:11.795036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:11.796158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:11.972402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:11.988515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-75958aa3-f483-49dc-ac68-564ae5928eec tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.310945 Sep 23 01:34:11.990108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 266/534] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:11 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:12.422909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:12.434989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-14f81cc8-effd-471d-9e8c-ca2321767c64 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.665765 Sep 23 01:34:12.436233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 269/535] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:11 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:12.552456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:12.554968 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:12.567009 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:12.567935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:12.568753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:12.569982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:12.570804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:12.571656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:12.826258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:12.837388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c03a03af-85d0-42b8-a380-65d70e5a6d70 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1663 microversion: 2.1 time: 0.292419 Sep 23 01:34:12.838026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 267/536] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:12 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1663 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:13.038486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:13.039099 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:13.049838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.050586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.051421 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:13.052489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.060532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.060532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:13.254977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:13.268076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e0e813d8-5b88-4c86-8c9d-15e48fe2579a tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.233873 Sep 23 01:34:13.268864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 270/537] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:13 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:13.468093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:13.469633 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:13.480901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.481828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.482643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:13.484012 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.484883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.485687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:13.705673 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:13.717312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d3305d18-ed68-414e-8814-cd80ad903c37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.256277 Sep 23 01:34:13.717747 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 268/538] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:13 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:13.868193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:13.869422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:13.882088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.883271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.892387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:13.892387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:13.892387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:13.892387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:14.168286 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:14.181659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-15b63382-5660-42d8-8623-010bca6dd1b2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1667 microversion: 2.1 time: 0.320813 Sep 23 01:34:14.182580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 271/539] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:13 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1667 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:14.299040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:14.303541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:14.310534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:14.311502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:14.312115 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:14.313001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:14.313692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:14.314351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:14.508789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:14.517474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-da442e6c-9164-4cf0-9f08-f4abdc09c9c8 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.224618 Sep 23 01:34:14.518069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 269/540] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:14 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:14.758683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:14.759298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:14.767345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:14.767864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:14.768303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:14.769010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:14.769486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:14.769902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:14.786652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:14.928064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:14.937729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3d1028ad-7bed-4ed8-9ba6-17e02d6d7fb4 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.183001 Sep 23 01:34:14.938360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 272/541] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:14 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:15.544451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:15.545351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:15.553237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:15.553733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:15.554198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:15.554912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:15.555458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:15.555925 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:15.747096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:15.755996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d23c1aed-12f8-4873-9d1f-0c3e8c705f51 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.216340 Sep 23 01:34:15.756592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 270/542] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:15 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:15.963957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:15.965217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:15.972708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:15.973211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:15.973682 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:15.974432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:15.974884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:15.975334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:16.230753 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:16.249259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-48b07a66-a962-424f-b0e2-a594ffaf775c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.288906 Sep 23 01:34:16.251371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 273/543] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:15 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:16.781306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:16.782176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:16.789559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:16.790047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:16.793646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:16.793646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:16.793646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:16.793646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:16.810432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:17.111805 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:17.127168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d9e4c602-f749-48c8-9d64-ed2c6a75b3e3 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.350195 Sep 23 01:34:17.148684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 271/544] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:16 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:17.288664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:17.289294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:17.298264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:17.298952 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:17.299525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:17.300348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:17.300876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:17.301337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:17.529938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:17.544854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-808b6447-3292-4aad-af25-7c9727bf5f53 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.257730 Sep 23 01:34:17.544854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 274/545] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:17 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:18.180020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:18.181895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:18.197914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:18.198761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:18.199647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:18.200894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:18.201642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:18.202288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:18.416270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:18.427720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3bbdc077-1124-474f-bf3e-f3ff3f3224e4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.256544 Sep 23 01:34:18.428340 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 272/546] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:18 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:18.569411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:18.570189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:18.577379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:18.577860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:18.578339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:18.579022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:18.579471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:18.579917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:18.790912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:18.805891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-396a2800-c960-4e99-97ce-12630ba5e61f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.240744 Sep 23 01:34:18.807067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 275/547] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:18 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:19.472612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:19.473937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:19.482542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:19.483031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:19.483466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:19.484196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:19.484642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:19.485108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:19.709313 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:19.725150 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0eca00c0-e004-42aa-9199-46d8be4a5885 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.258727 Sep 23 01:34:19.726228 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 273/548] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:19 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:19.847384 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:19.848343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:19.856133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:19.856869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:19.857369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:19.858161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:19.858685 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:19.859133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:20.026435 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:20.038339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-64c5aa47-f197-4931-9ad9-b5e9bb71be0f tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.195564 Sep 23 01:34:20.051579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 276/549] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:19 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:20.153827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8bde31-919a-498a-898a-c1a7fde0e80b", "name": "network-vif-plugged", "status": "completed", "tag": "8ef41830-75fb-4ad0-8285-a4080a6ebadc"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:20.164805 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:20.165586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:20.166034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:20.183415 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] Creating event network-vif-plugged:8ef41830-75fb-4ad0-8285-a4080a6ebadc for instance 3e8bde31-919a-498a-898a-c1a7fde0e80b on hv-cinder-84914 Sep 23 01:34:20.189240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-8d3a9a40-46d6-4ca9-a04f-00d093c73821 req-2963c5ba-c11b-49b4-889f-818f6872d5fc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039236 Sep 23 01:34:20.190468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 274/550] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:20.755996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:20.758254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:20.769799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:20.770677 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:20.771515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:20.772846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:20.773690 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:20.774478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:21.022816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:21.038602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-05fe9d39-b005-4b49-96d9-e8c6e902b610 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.288152 Sep 23 01:34:21.044781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 277/551] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:20 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:21.070571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:21.071759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:21.081037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:21.081575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:21.081977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:21.082739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:21.083195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:21.084166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:21.661368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:21.678471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-48f6e2f4-4050-4787-acef-2e59f425e330 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.615795 Sep 23 01:34:21.679199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 275/552] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:21 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:22.064339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:22.065363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:22.074170 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:22.074835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:22.075859 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:22.077480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:22.078313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:22.079068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:22.332465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:22.350124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bd430f01-0a6a-4cda-8cb2-b03ed0fbe973 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1319 microversion: 2.1 time: 0.290189 Sep 23 01:34:22.350963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 278/553] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:22 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:22.713328 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:22.715778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:22.729201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:22.730538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:22.731123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:22.732090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:22.732661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:22.733087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:23.005734 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:23.037914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9fb713f5-9220-4cd9-a5c7-8d501792df25 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.337293 Sep 23 01:34:23.039457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 276/554] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:22 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:23.381837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:23.382893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:23.387342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:23.396539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:23.398674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:23.400274 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:23.400857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:23.402602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:23.403427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:23.634041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:23.643792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d559cbcc-f738-4117-8378-c10a43ea6c8f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1509 microversion: 2.1 time: 0.269696 Sep 23 01:34:23.644991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 279/555] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:23 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1509 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:23.671250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16111b95-4152-49d6-a3c5-77512e7a5149", "device": "/dev/sdb"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:23.675453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:23.686250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:23.687133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:23.688039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:23.689303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:23.690160 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:23.690948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:24.074887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:24.077793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:24.096663 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:24.098194 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:24.099770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:24.103781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:24.103781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:24.103781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:24.342398 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:24.357028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6419d461-6f8a-4b89-a30f-9de6408e9927 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.294728 Sep 23 01:34:24.358003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 280/556] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:24 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:24.818815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-734da711-a44c-4efe-b473-d5e6a1c2377f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "POST /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.154505 Sep 23 01:34:24.827502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 277/557] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:34:23 2022] POST /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:25.382934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:25.383886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:25.392606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:25.393301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:25.394039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:25.395177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:25.395979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:25.396666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:25.604056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:25.615369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8c3d3efe-6234-45d4-ba5f-5b3d050c938a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.236490 Sep 23 01:34:25.616165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 281/558] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:25 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:26.641159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:26.642835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:26.650235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:26.650703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:26.652344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:26.652344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:26.652813 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:26.653388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:26.863043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:26.879893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-37c5a69c-660f-401c-9493-dc7e02be8636 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.242563 Sep 23 01:34:26.880964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 278/559] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:26 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:27.927182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:27.928737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:27.945684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:27.946302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:27.946935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:27.947800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:27.949615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:27.950090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:28.129716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:28.145155 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7c2ed595-b16d-4e99-a8b2-9306059c41dd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.226433 Sep 23 01:34:28.146695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 282/560] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:27 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:29.185700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:29.195608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:29.224677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=64 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:29.230380 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:29.235264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:29.235264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:29.235264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:29.236557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:29.237583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:29.605974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:29.616070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b0a7d35b-f4c5-4ce1-83f4-1842aee69246 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.444601 Sep 23 01:34:29.617170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 279/561] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:29 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:30.651280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:30.653142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:30.678495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:30.679212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:30.679994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:30.681242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:30.682288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:30.683265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:30.975709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:30.987697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ae8ae378-85ed-49ff-8596-5581f71fd910 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.350672 Sep 23 01:34:30.988575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 283/562] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:30 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:32.018157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:32.020416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:32.032815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:32.033945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:32.034834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:32.036321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:32.037226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:32.038141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:32.255628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:32.266974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e07f3225-c847-41a6-8822-c9e560dba819 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.256691 Sep 23 01:34:32.283807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 280/563] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:32 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:33.298231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:33.299348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:33.311411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:33.312355 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:33.313162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:33.314456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:33.315587 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:33.316596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:33.582022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:33.595374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c1922976-c6ee-4dc0-a559-9b8f581d4a0b tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.304674 Sep 23 01:34:33.603912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 284/564] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:33 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:34.620369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:34.621833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:34.631797 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:34.632704 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:34.636129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:34.637236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:34.638047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:34.638722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:34.845308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:34.855978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b7c626d1-d8a6-403d-b7d4-d3ad00ef1d59 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.240159 Sep 23 01:34:34.856732 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 281/565] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:34 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:35.149551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ed4813d1-2ab4-4f84-abd6-7d69df63b047 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Action: 'create', calling method: .version_select at 0x7f767904c670>, body: {"keypair": {"name": "tempest-TestShelveInstance-559886363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsXVaQHx3PjKnz8NVuzZi82LnAWX/ntDH3JgZUCcoUx+SPtMyZzS0lKfaHE8eHEaMcLQGK2FuBPSPGF1o5Ec7dXZsBUEbxMSI6rcFHh6TlACiO8Z8R2ZzxG+W7Kj/P8Ow=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:35.166006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ed4813d1-2ab4-4f84-abd6-7d69df63b047 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Getting quotas for project 600dd39d7a7944a49330866c0e26cb66. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:34:35.170214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ed4813d1-2ab4-4f84-abd6-7d69df63b047 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Getting quotas for user 8089cf57e0014489a12e659278c2931e and project 600dd39d7a7944a49330866c0e26cb66. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:34:35.492155 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ed4813d1-2ab4-4f84-abd6-7d69df63b047 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.536279 Sep 23 01:34:35.509240 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 285/566] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:34:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:35.886362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:35.887368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:35.893908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:35.894404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:35.894846 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:35.895579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:35.896057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:35.896483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:36.059044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:36.067598 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-82065fa4-f0e7-4752-8598-3ce03f31685d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.186139 Sep 23 01:34:36.070441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 282/567] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:35 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:37.092843 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:37.093688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:37.102347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:37.102977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:37.104961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:37.105992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:37.106580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:37.107250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:37.316333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:37.325493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8db38f95-ad1a-4af5-9cde-4bb095d8bf81 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.237684 Sep 23 01:34:37.339766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 286/568] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:37 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:38.349957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:38.350791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:38.358682 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:38.359168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:38.359831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:38.360760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:38.361367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:38.361799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:38.588222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:38.599291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4481dba1-b3e5-40d4-8890-6872eb1cf145 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.253316 Sep 23 01:34:38.611363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 283/569] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:38 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:39.634853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:39.635495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:39.642501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:39.642998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:39.643436 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:39.644174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:39.644635 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:39.645058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:39.798035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:39.806330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d9874da7-c926-44ee-8808-4e5bacb42bc6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.175483 Sep 23 01:34:39.806904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 287/570] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:39 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:40.834246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:40.836254 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:40.846954 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:40.847639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:40.848156 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:40.849389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:40.849883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:40.850320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:41.004762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:41.014031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f3999bb5-2eea-4019-800e-9aa8576a56f7 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.186367 Sep 23 01:34:41.014608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 284/571] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:40 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:42.038522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:42.039466 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:42.047977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.048614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.048913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.049716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.050086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.050506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.222366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:42.223478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:42.236599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.237544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.238316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.239621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.240543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.241263 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.302005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8920ccff-39ea-4131-aa1e-a072e74f21ee tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments/09d21352-9172-4c14-be79-5eed01e48cb0" status: 200 len: 194 microversion: 2.20 time: 0.081022 Sep 23 01:34:42.302005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 285/572] 10.222.0.64 () {60 vars in 1454 bytes} [Fri Sep 23 01:34:42 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments/09d21352-9172-4c14-be79-5eed01e48cb0 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:34:42.356296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:42.368400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bd442ab3-cf99-4fcb-b771-8a145fa6c306 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.334662 Sep 23 01:34:42.384303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 288/573] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:42 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:42.410888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:42.411584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:42.419095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.419706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.420040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.420741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.421196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.421611 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.514825 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'services' on Instance uuid dd3312b8-1d33-4b15-9ffd-270013a3b14d {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:42.675223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:42.807684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f9dc03ac-e2c8-445c-805c-32f96bdebd89 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments/09d21352-9172-4c14-be79-5eed01e48cb0" status: 202 len: 0 microversion: 2.20 time: 0.401521 Sep 23 01:34:42.808976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 286/574] 10.222.0.64 () {60 vars in 1457 bytes} [Fri Sep 23 01:34:42 2022] DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments/09d21352-9172-4c14-be79-5eed01e48cb0 => generated 0 bytes in 404 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:34:42.819985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:42.822505 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:42.829912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.830351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.830971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.831806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:42.832287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:42.832879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:42.865010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7fa32d8f-2665-49aa-9582-da49f7dfda74 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049610 Sep 23 01:34:42.865566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 289/575] 10.222.0.64 () {60 vars in 1343 bytes} [Fri Sep 23 01:34:42 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:34:43.397848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:43.398561 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:43.417523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:43.417523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:43.417523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:43.417523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:43.418209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:43.418209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:43.613530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:43.622779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5f600d03-9fe0-411c-bf73-386ea60c5f5e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.229747 Sep 23 01:34:43.623774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 287/576] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:43 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:43.879354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:43.881591 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:43.888776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:43.889256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:43.889892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:43.890371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:43.890814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:43.891227 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:43.895166 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:43.924950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ca0bd077-5866-48bf-b1fc-046325366bb8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049408 Sep 23 01:34:43.925695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 290/577] 10.222.0.64 () {60 vars in 1343 bytes} [Fri Sep 23 01:34:43 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:34:44.648042 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:44.648642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:44.655807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:44.658412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:44.658412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:44.658412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:44.658412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:44.658818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:44.799278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:44.809940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5a3dcd67-656b-4884-836d-407bcc0a0d21 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.165663 Sep 23 01:34:44.812958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 288/578] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:44 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:44.939928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:44.942096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:44.949365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:44.949980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:44.950340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:44.951042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:44.951486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:44.951968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:44.990806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dfb2a80f-6a96-48e5-8e75-bd188c7ed799 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055629 Sep 23 01:34:44.991378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 291/579] 10.222.0.64 () {60 vars in 1343 bytes} [Fri Sep 23 01:34:44 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:45.059922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:45.060445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:45.066626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.067142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.067647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.068388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.068841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.069330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.100483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:34:45.467345 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-de17cb0b-6667-4616-a948-27b06cae3f73 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 204 len: 0 microversion: 2.20 time: 0.411054 Sep 23 01:34:45.468101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 289/580] 10.222.0.64 () {60 vars in 1280 bytes} [Fri Sep 23 01:34:45 2022] DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 01:34:45.474445 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:45.478795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:45.479513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:45.487921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.488460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.488897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.489618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.490113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.490534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.650745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:45.661733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:45.664108 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:45.665344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2f34107f-3ecb-4479-98f8-0e3a69ff9662 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.191755 Sep 23 01:34:45.665912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 292/581] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:45 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:45.837255 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:45.837974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:45.845494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.845936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.846365 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.847060 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:45.847507 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:45.847947 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:45.990323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:45.999281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b0cd4a34-f372-4f69-82cc-bcb90502adef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.166248 Sep 23 01:34:45.999904 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 290/582] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:45 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:46.691866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:46.692473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:46.699136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:46.700152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:46.700589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:46.701279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:46.701736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:46.702192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:46.737683 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:46.738182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:46.745024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:46.745524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:46.745966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:46.746897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:46.747653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:46.748261 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:46.839227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lazy-loading 'services' on Instance uuid 3e8bde31-919a-498a-898a-c1a7fde0e80b {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:46.852105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:46.860673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:46.862132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:46.863543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8e181ac1-c2e6-45b3-a027-f012953a4c37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.175620 Sep 23 01:34:46.864125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 293/583] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:46 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:47.022457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:47.023057 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:47.033158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:47.033659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:47.034132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:47.034863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:47.035329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:47.035789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:47.123140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-34819568-a78e-433e-916c-8ded23944527 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b/os-volume_attachments/16111b95-4152-49d6-a3c5-77512e7a5149" status: 202 len: 0 microversion: 2.1 time: 0.389176 Sep 23 01:34:47.123780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 291/584] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:34:46 2022] DELETE /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b/os-volume_attachments/16111b95-4152-49d6-a3c5-77512e7a5149 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:34:47.196551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:47.205726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b9b5b542-e827-4757-9c85-bc00c91b6d1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.187115 Sep 23 01:34:47.206315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 294/585] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:47 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:47.890593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:47.891221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:47.907999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:47.908495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:47.908989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:47.909765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:47.910224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:47.910672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:48.078446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:48.089122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:48.089122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:48.089959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8a8fb303-e7de-44c3-aa9f-472dd960e8fc tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1725 microversion: 2.20 time: 0.204288 Sep 23 01:34:48.093910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 292/586] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:47 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:48.230264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:48.230904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:48.238700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:48.239184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:48.239829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:48.240817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:48.241474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:48.242089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:48.595379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:48.607816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a6113045-5564-4b3c-99a5-3b1b98f5b524 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.381012 Sep 23 01:34:48.608540 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 295/587] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:48 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:49.117455 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:49.118226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:49.125740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.126218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.126680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.127351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.127818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.129482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.203460 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:49.216144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:49.218412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:49.219914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-39a024ba-683e-453a-ba80-835c19bb61b3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1657 microversion: 2.20 time: 0.106203 Sep 23 01:34:49.226481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 293/588] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:49 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1657 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:49.233421 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd3312b8-1d33-4b15-9ffd-270013a3b14d", "name": "network-vif-deleted", "tag": "67de195b-49ec-4b3f-a46f-2918a89919f7"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:49.245375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.246249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.247710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.260239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] Creating event network-vif-deleted:67de195b-49ec-4b3f-a46f-2918a89919f7 for instance dd3312b8-1d33-4b15-9ffd-270013a3b14d on hv-cinder-84914 Sep 23 01:34:49.266056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-7537d8a3-689e-4cf2-88ca-7e65b6bdc703 req-f91bc2c4-0946-4bab-99e9-f2bc9a85a5d1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037647 Sep 23 01:34:49.267721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 296/589] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:34:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:49.376244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:49.376744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:49.383191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.384994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.385453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.386289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.386753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.387181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.415566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:34:49.636746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:49.639071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:49.646082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.646650 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.647148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.648040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.648659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.649084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.807775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:49.825713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a01194bf-c440-462e-90eb-0b5857c7fef9 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.195798 Sep 23 01:34:49.827039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 297/590] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:49 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:49.866761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-10717613-4f3a-40ca-b707-eab81ceddd54 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 204 len: 0 microversion: 2.1 time: 0.494081 Sep 23 01:34:49.867362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 294/591] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:34:49 2022] DELETE /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:34:49.878403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:49.879531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:49.908614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.908614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.908614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:49.908614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:49.909250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:49.909250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:50.063267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:50.063267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bdfb1d9c-a5a7-48c6-b8e0-b52c4cc080f4 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1515 microversion: 2.1 time: 0.187759 Sep 23 01:34:50.063267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 298/592] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:49 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:50.249578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:50.250512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:50.257283 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:50.257862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:50.258384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:50.260937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:50.260937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:50.260937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:50.297850 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:50.298206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:50.298594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:50.299050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid dd3312b8-1d33-4b15-9ffd-270013a3b14d {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:50.343407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:50.353212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:50.354646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:50.356416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-907eb746-9e21-4995-888b-5ead37f62a37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1372 microversion: 2.20 time: 0.111377 Sep 23 01:34:50.356974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 295/593] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:50 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:50.849725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:50.850432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:50.867252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:50.867834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:50.868436 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:50.870645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:50.871120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:50.871607 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.016776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:51.027412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5cf1e157-860a-4ba3-90eb-ffd26ac639c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.181279 Sep 23 01:34:51.029807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 299/594] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:50 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:51.086260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:51.086916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:51.094319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:51.095072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:51.095517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.096256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:51.096714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:51.097149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.237010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:51.244964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-590a7fe3-15d1-4acf-884b-3fc0f1eae7e1 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1515 microversion: 2.1 time: 0.162679 Sep 23 01:34:51.245536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 296/595] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:51 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:51.382947 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:51.383567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:51.391916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:51.392807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:51.393323 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.395950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:51.395950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:51.395950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.430451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:51.431043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:51.431457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:51.431935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid dd3312b8-1d33-4b15-9ffd-270013a3b14d {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:51.476006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:51.484841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:51.486348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:51.487513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-60769a4e-7923-40d1-b4a4-2ab03d0afee1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1372 microversion: 2.20 time: 0.108992 Sep 23 01:34:51.488117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 300/596] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:51 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1372 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:34:52.059750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:52.060661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:52.068160 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.068678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.069114 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.069815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.070264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.070684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.211171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:52.231485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6ce6cd07-8662-46be-a964-7a0e6c96290e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.177474 Sep 23 01:34:52.232159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 297/597] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:52 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:52.268945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:52.269724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:52.277075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.278048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.278534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.279225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.279701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.280144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.419164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:52.427372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dabb01e6-7f7f-4ce6-b330-65d78a401852 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1515 microversion: 2.1 time: 0.163313 Sep 23 01:34:52.427982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 301/598] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:52 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:52.514119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:52.514623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:52.520806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.521283 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.521710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.522392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.522839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.523253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.555350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:52.555860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:52.556325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:52.556727 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid dd3312b8-1d33-4b15-9ffd-270013a3b14d {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:52.599538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:52.602095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:52.609339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:52.610793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:52.616106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-db0a0b63-acca-4c34-8830-14859d129652 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 200 len: 1372 microversion: 2.20 time: 0.101893 Sep 23 01:34:52.616106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 298/599] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:52 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 1372 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:34:53.256458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:53.257066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:53.264193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.264681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.272456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.272456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.272456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.272456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.409171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:53.417870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-261c32d9-c9fb-4bb3-8b95-90f991878d36 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.166401 Sep 23 01:34:53.418995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 302/600] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:53 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:53.450693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:53.451617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:53.458893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.459377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.459837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.460536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.460991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.461410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.616536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:53.627407 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5a626ab0-dcb5-44ba-9b7c-60fc2680b29f tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1515 microversion: 2.1 time: 0.180620 Sep 23 01:34:53.628293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 299/601] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:53 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:53.641670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:53.642670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:53.650688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.651258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.652109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.653276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:53.653832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:53.654583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:53.672469 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d HTTP/1.1 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:34:53.674150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:34:53.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'dd3312b8-1d33-4b15-9ffd-270013a3b14d'} Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:34:53.676869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:34:53.678381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:53.680563 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:34:53.681444 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-55fc69aa-40de-4857-8f6b-1e727b252a8b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 404 len: 111 microversion: 2.20 time: 0.044883 Sep 23 01:34:53.682022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 303/602] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:34:53 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:34:53.692737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-579ed9b2-f193-40f8-8e4f-148cbe57df93 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '.version_select at 0x7f7679053d30>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:53.788202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-579ed9b2-f193-40f8-8e4f-148cbe57df93 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172169359" status: 204 len: 0 microversion: 2.20 time: 0.099468 Sep 23 01:34:53.789562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 300/603] 10.222.0.64 () {60 vars in 1262 bytes} [Fri Sep 23 01:34:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1172169359 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 01:34:54.177259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e8bde31-919a-498a-898a-c1a7fde0e80b", "name": "network-vif-deleted", "tag": "8ef41830-75fb-4ad0-8285-a4080a6ebadc"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:54.182423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:54.187899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:54.188365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:54.188838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:54.201394 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] Creating event network-vif-deleted:8ef41830-75fb-4ad0-8285-a4080a6ebadc for instance 3e8bde31-919a-498a-898a-c1a7fde0e80b on hv-cinder-84914 Sep 23 01:34:54.206970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-5ab6a7e8-d70f-4046-a700-559bd7b0ca86 req-136888f3-a0c0-4c88-ad5d-2f11da07f867 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033295 Sep 23 01:34:54.207595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 304/604] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:34:54.443445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:54.444235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:54.456663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:54.457733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:54.458422 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:54.459938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:54.460946 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:54.461445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:54.654507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:54.655335 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:54.661054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:54.663094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:54.663626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:54.664280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:54.665377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:54.666013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:54.666602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:54.675907 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e83631c5-2144-4ad3-a09b-f50287dd05d8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1735 microversion: 2.1 time: 0.238452 Sep 23 01:34:54.689644 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 301/605] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:54 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:54.786299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:54.796076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b6e1aa3d-4b94-4389-8ce4-c47dd5147721 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: .version_select at 0x7f76791ba5e0>, body: {"keypair": {"name": "tempest-keypair-1489334857", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOBhAva2QCaq+/yliwKtd/myqyw7vYkGz1lI4IGjzEhjrcCqckApTA4CjaIa9m2YHZsUV0F8nkcWzPn7e+i/HL+FpGxwzLXpHQsk/HGwVG6hSqv/boEjSVixWGcCYO+UYw=="}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:54.801300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d68fcfee-f836-4d1a-ae8a-2155af38d625 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1304 microversion: 2.1 time: 0.151833 Sep 23 01:34:54.802384 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 305/606] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:54 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1304 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:54.820459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-b6e1aa3d-4b94-4389-8ce4-c47dd5147721 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for project cc926b4dede94c3b92441b0c610771f6. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:34:54.825527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-b6e1aa3d-4b94-4389-8ce4-c47dd5147721 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for user 62f175cb5d1e4ac8a0ee95cf7718837b and project cc926b4dede94c3b92441b0c610771f6. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:34:54.960636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b6e1aa3d-4b94-4389-8ce4-c47dd5147721 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.169672 Sep 23 01:34:54.961143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 302/607] 10.222.0.64 () {62 vars in 1200 bytes} [Fri Sep 23 01:34:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 171 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 23 01:34:55.704383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:55.704998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:55.712651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:55.713331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:55.713768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:55.714475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:55.714928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:55.715939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:55.834320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:55.834963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:55.842949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:55.843739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:55.844384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:55.846399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:55.847202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:55.848124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:55.879834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:55.889825 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:55.890049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e7969e11-6910-4936-ac12-e77d154b6fef tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1715 microversion: 2.1 time: 0.190035 Sep 23 01:34:55.890622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:55.890788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 306/608] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:55 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1715 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:55.890898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:55.891232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lazy-loading 'fault' on Instance uuid 3e8bde31-919a-498a-898a-c1a7fde0e80b {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:34:55.937584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8982a7c52314c5a82d80a03d9a833d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95935852764e413c8bbd23c16ddf13a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:55.946742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6fd4e50a-18df-4cea-9cdd-97bd1b2329f7 tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 200 len: 1309 microversion: 2.1 time: 0.118138 Sep 23 01:34:55.947325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 303/609] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:55 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:34:56.013749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:56.030473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:56.030473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.030473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.030473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.032476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.033041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.033683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.124944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] HTTP exception thrown: Cannot 'detach_volume' instance f742ca8a-d7be-4ca0-9277-3a5a44421160 while it is in vm_state rescued Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Request method failure captured: Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments/9aeacf4f-5941-4fbf-a475-cdfb00877b17 HTTP/1.1 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYBYfcTzkvR_x_fgIoxQGBOVYevi2Zp0PQLNN5Adxub1momkDvhIUnyFD_xKYjC8o2mSrGKkiNqU7YlOSJNrmN9iRcrS5T9B-cW3MfIfRBifWzhuUFzwbGBgz-iR7DgoI3fh3hU9AO84ILe7Fwq53zwDcFXPnC_TPq0HyQXNH8MCc Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:34:56.126293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b8939e407ff4bdc81191af7f0593cd5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: da9978cab3fb4bdda39a2e4718ee2cc7 Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:34:56.128117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Cannot 'detach_volume' instance f742ca8a-d7be-4ca0-9277-3a5a44421160 while it is in vm_state rescued Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'server_id': 'f742ca8a-d7be-4ca0-9277-3a5a44421160', 'id': '9aeacf4f-5941-4fbf-a475-cdfb00877b17'} Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:34:56.128807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f742ca8a-d7be-4ca0-9277-3a5a44421160 while it is in vm_state rescued Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f742ca8a-d7be-4ca0-9277-3a5a44421160 while it is in vm_state rescued Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:34:56.130726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Returning 409 to user: Cannot 'detach_volume' instance f742ca8a-d7be-4ca0-9277-3a5a44421160 while it is in vm_state rescued {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:34:56.132497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c5e5bcdd-3da3-4d66-ab04-427eb939b4fd tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments/9aeacf4f-5941-4fbf-a475-cdfb00877b17" status: 409 len: 152 microversion: 2.1 time: 0.118734 Sep 23 01:34:56.132497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 307/610] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:34:56 2022] DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments/9aeacf4f-5941-4fbf-a475-cdfb00877b17 => generated 152 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 23 01:34:56.136690 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:56.137796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:56.147063 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.147709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.148449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.149357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.149815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.154213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.475979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ac147fc5-8888-431b-82f3-916f85161667 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/action" status: 202 len: 0 microversion: 2.1 time: 0.342969 Sep 23 01:34:56.476811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 304/611] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:34:56 2022] POST /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:34:56.487830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:56.488266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:56.496214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.496214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.496741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.497442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.498135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.498548 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.515801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:56.715639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:56.724754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e864cc06-d42a-421a-a3e5-0340f2b01ec0 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.241767 Sep 23 01:34:56.725341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 308/612] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:56 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:56.973821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:56.979272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] [instance: 3e8bde31-919a-498a-898a-c1a7fde0e80b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:56.981845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.982339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.982779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.983580 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:56.984051 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:56.984481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:56.999032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] HTTP exception thrown: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Request method failure captured: Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b HTTP/1.1 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQyOisqcKySX08SKehwWXSvSwmwjlxFJqE1SxoUNH6Zh70SzgGPStCDPj_mQ6lLz8QFR1bvz-Ff992yPhTZ-XaAtzBvGJzdVKSx816xXAYSsaDd-Pni685KHx_zWaSPPomMf1M4gPYipUEcBmPDq_zKoESj0cEiJLOUErvOVIvbWTEQ Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 95935852764e413c8bbd23c16ddf13a5 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:34:57.000774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/95935852764e413c8bbd23c16ddf13a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_95935852764e413c8bbd23c16ddf13a5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 95935852764e413c8bbd23c16ddf13a5 Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1834860145 Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesSnapshotTestJSON-1834860145-project Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: c8982a7c52314c5a82d80a03d9a833d6 Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesSnapshotTestJSON-1834860145-project Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. Sep 23 01:34:57.002127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '3e8bde31-919a-498a-898a-c1a7fde0e80b'} Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:34:57.002854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. Sep 23 01:34:57.004097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:34:57.005178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] Returning 404 to user: Instance 3e8bde31-919a-498a-898a-c1a7fde0e80b could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:34:57.005178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-aed841df-2f68-45df-8bd2-379331657d3b tempest-VolumesSnapshotTestJSON-1834860145 tempest-VolumesSnapshotTestJSON-1834860145-project] 10.222.0.64 "GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b" status: 404 len: 111 microversion: 2.1 time: 0.034891 Sep 23 01:34:57.005178 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 305/613] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:56 2022] GET /compute/v2.1/servers/3e8bde31-919a-498a-898a-c1a7fde0e80b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:34:57.757065 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:57.757809 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:57.769373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:57.769867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:57.770303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:57.771008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:57.771459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:57.771913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:58.013448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:58.022123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-742b2aad-cb1a-4a15-932f-248dc4f0008a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.276635 Sep 23 01:34:58.022706 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 309/614] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:57 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:34:58.450202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2073843916", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fd195584-9c0f-4bc1-8f70-84ad33facee8"}], "security_groups": [{"name": "tempest-securitygroup--1955135814"}], "key_name": "tempest-keypair-1489334857", "user_data": "}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:34:58.573317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.network.neutron [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] validate_networks() for [('fd195584-9c0f-4bc1-8f70-84ad33facee8', None, None, None, None, None)] {{(pid=121763) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:34:58.987945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Flavor limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:34:58.988386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Image limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:34:58.988917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Flavor pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:34:58.989336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Image pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:34:58.989753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:34:58.999636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:59.000131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:59.000572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:59.001331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:59.001875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:59.002304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:59.021478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for project cc926b4dede94c3b92441b0c610771f6. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:34:59.026384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Getting quotas for user 62f175cb5d1e4ac8a0ee95cf7718837b and project cc926b4dede94c3b92441b0c610771f6. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:34:59.040560 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Going to run 1 instances... {{(pid=121763) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:34:59.043493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:34:59.046366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:34:59.047054 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:34:59.054304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:59.054790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:59.055225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:59.055944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:34:59.056387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:34:59.056805 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:34:59.065113 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:34:59.180739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [924b8e4e-4bc1-4ab5-a55a-0fde5df809c7] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 23 01:34:59.204709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:34:59.213318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff446c5a-63a9-4433-b64f-c3bd5960d289 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.170938 Sep 23 01:34:59.213897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 310/615] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:34:59 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:00.188657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO oslo.messaging._drivers.impl_rabbit [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [924b8e4e-4bc1-4ab5-a55a-0fde5df809c7] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 40224. Sep 23 01:35:00.194757 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2f9a3c2f-dc46-4d6d-a415-e6992c232d4d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.748643 Sep 23 01:35:00.196277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 306/616] 10.222.0.64 () {62 vars in 1188 bytes} [Fri Sep 23 01:34:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1751 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 23 01:35:00.208532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:00.209403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:00.237193 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:00.238265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:00.245622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:00.246449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:00.247134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:00.248484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:00.249237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:00.250151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:00.275031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:00.284894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:00.286372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:00.287500 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7ab67b21-e39f-4c16-81ae-05e7185dd324 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1282 microversion: 2.20 time: 0.083084 Sep 23 01:35:00.297446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 311/617] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:00 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:00.444824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:00.445621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-55673820", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-559886363", "security_groups": [{"name": "tempest-secgroup-smoke-1850846517"}], "networks": [{"uuid": "2b18b98c-5d4a-416e-872c-bd1f7589d912"}], "block_device_mapping_v2": [{"uuid": "78e3f35a-09cc-4d13-8e91-979168a1cb79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:00.473933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c8f2eed3-afd0-474e-bf31-4b26f44cd8a8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.231090 Sep 23 01:35:00.477812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 307/618] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:00 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:00.573871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] validate_networks() for [('2b18b98c-5d4a-416e-872c-bd1f7589d912', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:35:01.048305 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:35:01.048727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:35:01.049198 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:35:01.049884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:35:01.051106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:35:01.066581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.067064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.067492 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.068387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.068726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.069141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.087694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Getting quotas for project 600dd39d7a7944a49330866c0e26cb66. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:35:01.092451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Getting quotas for user 8089cf57e0014489a12e659278c2931e and project 600dd39d7a7944a49330866c0e26cb66. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:35:01.158614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:35:01.161097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='78e3f35a-09cc-4d13-8e91-979168a1cb79',volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:35:01.374069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:01.384395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:01.384395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.384395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.384395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.385730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.385730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.385730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.462619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:01.473586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:01.475036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:01.476267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3904a0a5-b3d1-4d97-aa2f-d12930a4a7f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1286 microversion: 2.20 time: 0.166682 Sep 23 01:35:01.476842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 308/619] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:01 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:35:01.502310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:01.502919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:01.509517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.510003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.510433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.511123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:01.511647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:01.512095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:01.655325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:01.664090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f0309d7d-c431-4dbd-925b-1fa676d36a19 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.165513 Sep 23 01:35:01.664663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 309/620] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:01 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:01.736149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-daf3c454-3bb0-4a23-a701-8926eb4d9d86 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.294145 Sep 23 01:35:01.737340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 312/621] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:35:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:35:01.748773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-de9ede33-282a-407f-9bf1-1740345130d4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:01.749379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-de9ede33-282a-407f-9bf1-1740345130d4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:01.808098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-de9ede33-282a-407f-9bf1-1740345130d4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:01.816223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-de9ede33-282a-407f-9bf1-1740345130d4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1086 microversion: 2.1 time: 0.071384 Sep 23 01:35:01.816819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 310/622] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:01 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1086 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:02.502547 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:02.503340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:02.510455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:02.510999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:02.511437 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:02.512207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:02.512662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:02.513086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:02.580051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:02.588983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:02.590443 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:02.591716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-499d8512-8bc9-49f6-8569-cb728994dff4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1286 microversion: 2.20 time: 0.093099 Sep 23 01:35:02.592290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 313/623] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:02 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:02.742585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:02.749259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:02.750139 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:02.750636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:02.751081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:02.751852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:02.752335 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:02.752761 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:02.842214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f1b6754c-5784-40f3-a133-726f97ef55f2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:02.852867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f1b6754c-5784-40f3-a133-726f97ef55f2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:02.931153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f1b6754c-5784-40f3-a133-726f97ef55f2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:02.936806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:02.951173 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f1b6754c-5784-40f3-a133-726f97ef55f2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1086 microversion: 2.1 time: 0.111453 Sep 23 01:35:02.951274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-329b7207-dde3-4026-9eaa-69dbfe450cea tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1723 microversion: 2.1 time: 0.264956 Sep 23 01:35:02.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 311/624] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:02 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:02.959013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 314/625] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:02 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1086 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:03.105916 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.108349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.114716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.115205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.115708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.116388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.116840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.117265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.163222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-244f0a2c-d4aa-477e-bb8e-67d8e57d679d tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061534 Sep 23 01:35:03.163906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 315/626] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:35:03 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:35:03.231481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.232008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.241891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.242350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.242789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.243485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.244050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.244494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.285410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:35:03.617847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.618583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.636597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.637765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.638317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.639105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.639680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.640146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.706212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e21a5e66-d0f1-4631-8b97-2eb2c1aec290 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 204 len: 0 microversion: 2.1 time: 0.478316 Sep 23 01:35:03.706806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 312/627] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:35:03 2022] DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:35:03.709672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:03.716412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.716606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.718162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:03.719975 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:03.721111 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9703ac1f-b573-4642-b1d2-1f91d15cc64c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1334 microversion: 2.20 time: 0.107539 Sep 23 01:35:03.721674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 316/628] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:03 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:03.723404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.723927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.724354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.725050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.725501 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.725922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.877077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:03.885485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8b9dc495-7439-4497-8473-58e37de536d6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1673 microversion: 2.1 time: 0.173779 Sep 23 01:35:03.886189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 313/629] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:03 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:03.972318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.973076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:03.973208 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.973533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:03.980936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.981279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.981587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.981705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.982018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.982161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.982834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.983287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.983953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:03.984290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:03.984776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:03.985211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.051921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:04.062311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e71910e8-1ed8-42c4-bd14-88181e9f61a1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1128 microversion: 2.1 time: 0.095122 Sep 23 01:35:04.062902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 317/630] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:03 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1128 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:04.125285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:04.133859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-43cf8f82-48bd-497b-82a9-fd82f829786c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1729 microversion: 2.1 time: 0.165504 Sep 23 01:35:04.134437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 314/631] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:03 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:04.160928 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:04.161417 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:04.167569 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.168074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.168503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.169195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.169640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.170127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.255364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8811f70e-6e09-4ae8-9c6b-ac85d91ff0de tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098178 Sep 23 01:35:04.255927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 318/632] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:35:04 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:04.746709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:04.747436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:04.754083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.754671 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.755176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.755913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.756373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.756802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.834077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:04.842783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:04.844295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:04.845654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0b5e6fc4-de0a-4886-84ca-90a595cb62e7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1334 microversion: 2.20 time: 0.103650 Sep 23 01:35:04.846208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 315/633] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:04 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:04.911038 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:04.911743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:04.918802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.920604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.920604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:04.920845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:04.921157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:04.921592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:05.086867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:05.087758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:05.095209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:05.095885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:05.096388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:05.097151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:05.097625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:05.098247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:05.148727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:05.158994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-87286dcc-1018-408f-b76c-297f1066d421 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1673 microversion: 2.1 time: 0.252428 Sep 23 01:35:05.159945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 319/634] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:04 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:05.174895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:05.177359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:05.183806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0e535f6e-dea0-4626-8233-f9eff1432342 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1128 microversion: 2.1 time: 0.100816 Sep 23 01:35:05.184609 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 316/635] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:05 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1128 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:05.372876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:05.384762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:05.385235 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:05.385662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:05.406623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] Creating event network-changed:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:35:05.412333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-34355bb0-f9e6-4631-8e36-2da5ae03b058 req-601e016c-a51a-45be-91d5-281f134b69aa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044203 Sep 23 01:35:05.412877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 320/636] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:05.879748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:05.880969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:05.893880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:05.894641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:05.895208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:05.896164 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:05.896678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:05.897242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:06.188507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:06.190237 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:06.198361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:06.199277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:06.202457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:06.202457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:06.203336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:06.204029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:06.290706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:06.308516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:06.312166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:06.314468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8e5b4690-c910-494d-bf36-7d800ec35157 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1334 microversion: 2.20 time: 0.445154 Sep 23 01:35:06.315373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 317/637] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:05 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1334 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:06.320963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:06.321907 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:06.330461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:06.331432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:06.332102 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:06.333204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:06.334014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:06.335093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:06.442596 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:06.457110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-17455f34-19e9-4b88-bb67-cb15a9c2e4b1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1128 microversion: 2.1 time: 0.140360 Sep 23 01:35:06.458008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 318/638] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:06 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1128 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:06.465987 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:06.474983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1bd98e15-9046-4bcc-a22b-78cfcd64062b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1673 microversion: 2.1 time: 0.293148 Sep 23 01:35:06.475883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 321/639] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:06 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1673 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:07.357884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:07.361022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:07.374711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.375619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.377081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.378590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.379443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.380336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.450600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:07.479089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.480051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.482940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.518475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] Creating event network-changed:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:35:07.524659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e3a0d975-29c1-4d83-9911-bccc0f60d1b7 req-52d66a4d-0fc9-4f2c-8e0b-cd3d2774a7b3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081658 Sep 23 01:35:07.529412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 322/640] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:07.533672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:07.534439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:07.543802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:07.544378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.545043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.545495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.546326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.546699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.547179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.571474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:07.580343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:07.580343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0b47f59e-e150-4c18-9c4f-9f06094196d5 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1340 microversion: 2.20 time: 0.229016 Sep 23 01:35:07.580343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 319/641] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:07 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1340 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:07.591262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:07.592638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:07.606409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.610142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.611575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.628154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:07.629642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:07.631822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:07.713032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:07.726703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b1cf576b-6792-42ae-8b1e-a68365e27dd3 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1184 microversion: 2.1 time: 0.199832 Sep 23 01:35:07.734818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 323/642] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:07 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1184 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:07.761548 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:07.772188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-40f66607-2a0b-436d-82e9-ee657b3042b7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1606 microversion: 2.1 time: 0.190133 Sep 23 01:35:07.773053 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 320/643] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:07 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1606 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:08.628612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:08.629899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:08.647036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:08.647036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:08.650562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:08.651689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:08.655163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:08.657404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:08.766137 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:08.772010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:08.844876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:08.850853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:08.853026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:08.854381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:08.859274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:08.860107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:09.010031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:09.026664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:09.040050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9ff6efec-4368-426f-a9d5-74a0d5a3a624 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1202 microversion: 2.1 time: 0.287395 Sep 23 01:35:09.041487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 321/644] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:08 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1202 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:09.049684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:09.051175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:09.062285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:09.064661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:09.064661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:09.082055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:09.083020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:09.085619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:09.140187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:09.142594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:09.143938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:09.145645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:09.281345 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:09.291451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1a1e24a3-0b06-4fd2-bb3d-23a0bab4878b tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1327 microversion: 2.1 time: 0.246286 Sep 23 01:35:09.292397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 322/645] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:09 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1327 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:09.561379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09ce20b4-a04e-4dc8-b694-50be8ee53310", "name": "network-vif-deleted", "tag": "c8abb555-0222-4db9-8cfd-ae8b447de34c"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:09.577883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:09.581956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:09.581956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:09.594327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] Creating event network-vif-deleted:c8abb555-0222-4db9-8cfd-ae8b447de34c for instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 on hv-cinder-84914 Sep 23 01:35:09.600227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-850d60ff-b3b4-499f-8fa5-e3045ecf3fbf req-7e244c0c-e65a-4be6-b50e-022ebb6e1eae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046053 Sep 23 01:35:09.601216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 323/646] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:09.653298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:09.664652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:09.670701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:09.671932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6b4fe113-7bab-4693-8e86-7d2c504082bb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 1.056585 Sep 23 01:35:09.672840 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 324/647] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:08 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:10.098660 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:10.099338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:10.111389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.111966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.112412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.113686 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.113686 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.113999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.242993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:10.253451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cecba8a0-84f0-452a-aafe-51c819bec9ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1202 microversion: 2.1 time: 0.159812 Sep 23 01:35:10.253451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 324/648] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:10 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:10.319759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:10.320530 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:10.327485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.328352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.329595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.335801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.335801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.335801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.383390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.384222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.385131 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.386008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:10.452570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:10.460958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4b013aff-4f27-437a-821e-06975b310b09 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1327 microversion: 2.1 time: 0.145323 Sep 23 01:35:10.462230 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 325/649] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:10 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1327 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:10.667135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:10.672319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.672782 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.673252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.686641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] Creating event network-changed:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:35:10.692610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-6d054729-0003-4168-99e2-423eb914d884 req-d9b7a77f-c429-4971-bedd-86e6202732a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035681 Sep 23 01:35:10.693068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 325/650] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:35:10.713735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:10.713735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:10.715709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.716222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.716657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.717374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:10.717830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:10.718255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:10.883421 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:10.895688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:10.897320 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:10.898481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ebae7e65-7f8b-4e68-a029-45f9928ccca1 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.198159 Sep 23 01:35:10.899361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 326/651] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:10 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:11.277127 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:11.277956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:11.287472 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.289040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.289878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.290820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.291434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.296541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.479016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:11.488556 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:11.489536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:11.495480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:11.496074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0921d14e-9ddc-498d-9a96-b56443c0760a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1270 microversion: 2.1 time: 0.224534 Sep 23 01:35:11.497932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 326/652] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:11 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:11.498804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.499300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.499768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.500481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.502230 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.502230 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.540299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.541036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.541309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.541749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:11.595577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:11.604500 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8416c7a8-6d95-4ed1-a371-1ec49a898bf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1327 microversion: 2.1 time: 0.120202 Sep 23 01:35:11.606128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 327/653] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:11 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:11.937807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:11.938976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:11.942473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=12 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:11.948829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.954298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.954298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:11.954298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:11.954298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:11.954906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.112903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:12.122531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:12.124074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:12.125202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e4ea55ab-20b3-491f-9fe1-eb6bb4576279 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.195401 Sep 23 01:35:12.125777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 327/654] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:11 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:12.521939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:12.522634 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:12.531710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:12.532255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:12.532765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.533508 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:12.533965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:12.534409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.628990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:12.629831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:12.638473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:12.639478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:12.640828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.641950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:12.642695 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:12.646554 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.688157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:12.688680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:12.689126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:12.689588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:12.737318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:12.739920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:12.746693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-fb971a8a-aa26-4d76-83c9-6011e92c65b8 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1327 microversion: 2.1 time: 0.121476 Sep 23 01:35:12.747292 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 328/655] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:12 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:12.756302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:12.767535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e2658112-bd2f-400f-b2ef-039474360aaa tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1270 microversion: 2.1 time: 0.248629 Sep 23 01:35:12.768154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 328/656] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:12 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1270 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:13.156632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:13.157903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:13.169387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.170223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.170913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.171984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.172707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.173209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.571567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:13.593665 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:13.597552 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:13.599238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5f703bee-eb90-4aa0-a20b-872cec8ace9e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.450273 Sep 23 01:35:13.600295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 329/657] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:13 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:13.774232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:13.776645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:13.787383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=10 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:13.791870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.793557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.794613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.796416 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.797776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.798735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.815877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:13.820243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:13.852118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.853177 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.854101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.857369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.859271 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.860192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.887925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:13.888874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:13.889636 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:13.890483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 09ce20b4-a04e-4dc8-b694-50be8ee53310 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:13.964011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:13.977982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a57c615e-ec4d-44fd-a1b8-100adf497515 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 200 len: 1327 microversion: 2.1 time: 0.210660 Sep 23 01:35:13.978958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 329/658] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:13 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 1327 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:14.288561 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:14.298888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-315840e5-5ba7-49b4-b204-26c4f73c4a57 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.491027 Sep 23 01:35:14.299956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 330/659] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:13 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:14.643246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:14.644214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:14.653633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:14.653633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:14.653633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:14.654388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:14.655055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:14.655743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:14.822921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:14.833034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:14.834491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:14.835684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-32c31145-7841-4cb6-b765-aca9521cf4f7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.196558 Sep 23 01:35:14.836246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 330/660] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:14 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:15.033330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:15.034490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:15.045483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.045982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.046454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.047370 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.048033 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.049564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.054556 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:15.077829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.077983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.078913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.088059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 HTTP/1.1 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:35:15.092961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:35:15.095431 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '09ce20b4-a04e-4dc8-b694-50be8ee53310'} Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:35:15.096710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:35:15.098653 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:35:15.106532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:35:15.106532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-09aa791d-4cc9-47e5-81b2-0a7989fb88a1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 404 len: 111 microversion: 2.1 time: 0.068097 Sep 23 01:35:15.106532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 331/661] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:15 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:35:15.107088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] Creating event network-changed:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:35:15.114005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-33a5d149-da67-46c9-8e1a-0bdd608b1ae7 req-b5515c1d-9017-4607-9667-46fda9d72520 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068839 Sep 23 01:35:15.115174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 331/662] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:15.117617 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-28614ca5-4831-49a2-83c2-12dcef7c76a6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '.version_select at 0x7f76790a8d30>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:15.244528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-28614ca5-4831-49a2-83c2-12dcef7c76a6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586208936" status: 202 len: 0 microversion: 2.1 time: 0.139881 Sep 23 01:35:15.245108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 332/663] 10.222.0.64 () {58 vars in 1221 bytes} [Fri Sep 23 01:35:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586208936 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:35:15.324648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:15.325575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:15.334064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.334851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.335501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.336261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.336740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.344574 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.541846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:15.550851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-09aaa1a2-501c-404f-b949-c4cb6d5f9ef0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.230485 Sep 23 01:35:15.551485 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 332/664] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:15 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:15.865005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:15.865647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:15.878819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.879500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.884326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:15.884326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:15.884326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:15.884326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:16.102390 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:16.112674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:16.115193 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:16.116792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-78eaf324-0a96-45c9-868a-3dba5581489b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.258181 Sep 23 01:35:16.131599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 333/665] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:15 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:16.556883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fbabb3a3-48f3-4b01-a2f7-7085a54c26c1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: .version_select at 0x7f7678fdcaf0>, body: {"keypair": {"name": "tempest-keypair-243580435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyl7dUzY3R0gxRgf9MAyUfsMS7ljEx/x6kGtLo0K+7RLMGq7TAgdM0YAOTG01UMJNG0lcXtswUkXIHgVsSYgPEZGLqLajpFibA71Gevq9wqsCYoBenNE/r8oibp15YG1w=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:16.575348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:16.576094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:16.576957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-fbabb3a3-48f3-4b01-a2f7-7085a54c26c1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for project 92e9b7f9904f437f91148da9fc521326. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:35:16.582301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-fbabb3a3-48f3-4b01-a2f7-7085a54c26c1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for user 1633ea35eda34ffe884140eaab1ae909 and project 92e9b7f9904f437f91148da9fc521326. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:35:16.591092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:16.591092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:16.591092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:16.591092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:16.591486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:16.591486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:16.686425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fbabb3a3-48f3-4b01-a2f7-7085a54c26c1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133363 Sep 23 01:35:16.687375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 333/666] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:35:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:35:16.870884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:16.881707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4dee3807-e3df-4a32-9345-bf411688c6eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.311108 Sep 23 01:35:16.882600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 334/667] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:16 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:17.145009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:17.146251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:17.157424 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:17.158351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:17.159097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:17.160098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:17.161100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:17.161734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:17.314526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:17.330484 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:17.333528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:17.335612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f06144e2-0b97-4b82-891c-3efa4ea7ab7b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.196111 Sep 23 01:35:17.337628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 334/668] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:17 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:17.906428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:17.907062 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:17.914218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:17.918236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:17.918236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:17.918236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:17.918236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:17.918879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:18.085658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:18.089823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:18.102069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9842afd2-fef9-41be-a845-99dce67872ad tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.199334 Sep 23 01:35:18.102936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 335/669] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:17 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:18.370750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:18.372359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:18.380628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:18.381349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:18.381938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:18.382714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:18.383292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:18.383891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:18.568550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:18.576955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:18.578489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:18.579709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-92536b98-87ad-4f6f-814a-dd23a89e9db4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.216760 Sep 23 01:35:18.580271 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 335/670] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:18 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:19.127719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:19.129057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:19.138240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:19.138612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:19.139146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:19.140207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:19.140798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:19.141355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:19.344095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:19.358759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1fb0df21-14cd-464a-952e-231faabea3e0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.235775 Sep 23 01:35:19.372467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 336/671] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:19 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:19.602391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-131318815", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62c29b3e-b2e8-4dd4-ada2-85bc80343af4"}], "security_groups": [{"name": "tempest-securitygroup--2093404885"}], "key_name": "tempest-keypair-243580435", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:19.607098 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:19.607743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:19.617672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:19.618350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:19.618822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:19.620944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:19.620944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:19.621777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:19.623197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:19.731539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] validate_networks() for [('62c29b3e-b2e8-4dd4-ada2-85bc80343af4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:35:19.819803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:19.829425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:19.831744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:19.833289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e1c41c55-0332-413e-99ee-f5988f837cc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.231315 Sep 23 01:35:19.848766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 337/672] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:19 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:20.292480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:35:20.294121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:35:20.294776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:35:20.295277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:35:20.295879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:35:20.312947 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.313440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.313888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:20.314890 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.315406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.315876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:20.335914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for project 92e9b7f9904f437f91148da9fc521326. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:35:20.340772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Getting quotas for user 1633ea35eda34ffe884140eaab1ae909 and project 92e9b7f9904f437f91148da9fc521326. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:35:20.356362 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:35:20.359003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:35:20.386847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:20.387816 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:20.396118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.396661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.397167 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:20.397957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.398639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.399142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:20.518448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2d32d65b-5713-4c7e-985e-7b48d4b1dc25 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.920344 Sep 23 01:35:20.519720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 336/673] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:35:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:35:20.536640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-35e346f2-ff20-4d34-9c54-06ebd1250048 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:20.537274 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-35e346f2-ff20-4d34-9c54-06ebd1250048 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:20.609315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:20.618963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0b2f153-1ac9-47d6-b02b-c8c8f62fcba0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.238364 Sep 23 01:35:20.619585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 338/674] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:20 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:20.624460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-35e346f2-ff20-4d34-9c54-06ebd1250048 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:20.637009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-35e346f2-ff20-4d34-9c54-06ebd1250048 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1236 microversion: 2.1 time: 0.104246 Sep 23 01:35:20.637715 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 337/675] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:20 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1236 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:20.864135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:20.864771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:20.874174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.874932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.875524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:20.876501 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:20.876991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:20.895329 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:21.028442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:21.037207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:21.038729 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:21.039979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-710c3edc-b561-404e-ba52-87476130e14c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.181248 Sep 23 01:35:21.040520 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 339/676] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:20 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:21.328598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "name": "network-vif-plugged", "status": "completed", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:21.340581 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:21.342814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:21.342814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:21.357399 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] Creating event network-vif-plugged:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:35:21.364851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-3d09a1c5-a8a5-4f6e-95c2-0fd4005464bf req-71843e6d-3dd3-4dba-9fc4-dc274213de09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040814 Sep 23 01:35:21.365601 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 338/677] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:21.646034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:21.647721 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:21.653709 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:21.654259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:21.654700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:21.655419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:21.655913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:21.656341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:21.670787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-10141e73-4153-4997-9b0b-db819e0efe0f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:21.672489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-10141e73-4153-4997-9b0b-db819e0efe0f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:21.742742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-10141e73-4153-4997-9b0b-db819e0efe0f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:21.752378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-10141e73-4153-4997-9b0b-db819e0efe0f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1236 microversion: 2.1 time: 0.088551 Sep 23 01:35:21.753260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 339/678] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:21 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1236 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:21.863151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:21.878651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-258b6853-3c28-4a6c-944b-83aeed808fb0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.236854 Sep 23 01:35:21.880092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 340/679] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:21 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:22.074308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:22.075673 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:22.089336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.090204 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.090994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:22.092315 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.093160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.093899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:22.278516 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:22.295791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:22.299277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:22.301679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e0f47e29-3ec8-4984-a8f2-016eb6a9479f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.234324 Sep 23 01:35:22.302746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 340/680] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:22 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:22.779423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:22.780742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:22.791110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.791902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.792427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:22.793443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.794089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.794596 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:22.883356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:22.898984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f496bceb-bf03-4e00-9fc2-275b9336afb7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1232 microversion: 2.1 time: 0.124128 Sep 23 01:35:22.900085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 341/681] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:22 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1232 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:22.915473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:22.916503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:22.924073 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.924562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.924980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:22.925903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:22.926512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:22.927007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:23.095589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:23.104596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9844739b-c5c0-4e7b-bccb-35f9bdb16c56 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.193302 Sep 23 01:35:23.105628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 341/682] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:22 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:23.344763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:23.344763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:23.351834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:23.352338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:23.352775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:23.353495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:23.353956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:23.354386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:23.518257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:23.527131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:23.536858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:23.536858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-95becdaa-6ec0-4ec9-82ea-823ab8927888 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1408 microversion: 2.20 time: 0.190118 Sep 23 01:35:23.536858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 342/683] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:23 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:23.932722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:23.933631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:23.940410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:23.941217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:23.941370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:23.942023 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:23.942474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:23.942894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.022227 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:24.030921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8bd89fc6-a24e-42b1-bdea-33939a76d104 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1288 microversion: 2.1 time: 0.109385 Sep 23 01:35:24.031513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 342/684] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:23 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1288 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:24.129572 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:24.130310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:24.138338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.139139 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.139625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.140343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.140802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.141231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.296994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:24.305884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1aa21e71-c95c-4ff7-9f1f-a61f90ded534 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.180393 Sep 23 01:35:24.306519 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 343/685] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:24 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:24.555772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:24.556382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:24.563836 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.564765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.565130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.565846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.566306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.566728 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.732800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:24.753600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:24.755463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:24.756582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-64a62593-6d74-4515-81e0-c02094602ded tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1601 microversion: 2.20 time: 0.204879 Sep 23 01:35:24.757199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 343/686] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:35:24 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1601 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:35:24.783493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:24.784020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:24.791097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.791608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.792054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.793292 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:24.793757 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:24.794185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:24.884624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d7255ab6-b32f-455e-b7f4-bac74d2764a2 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.105223 Sep 23 01:35:24.885283 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 344/687] 10.222.0.64 () {60 vars in 1316 bytes} [Fri Sep 23 01:35:24 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-interface => generated 285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:35:25.060205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:25.061291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:25.072675 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:25.073599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:25.074778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:25.076007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:25.076745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:25.077735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:25.161572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:25.175870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-95a2228b-a65b-4442-86d1-6c4441fb2008 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1288 microversion: 2.1 time: 0.123253 Sep 23 01:35:25.176737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 344/688] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:25 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1288 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:25.337495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:25.339706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:25.352602 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:25.353991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:25.354719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:25.356026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:25.356875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:25.357655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:25.927600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:25.940096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-82e7e26e-15b3-45fe-8df8-87fcc9b71ae2 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.611366 Sep 23 01:35:25.941594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 345/689] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:25 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:26.202276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:26.204587 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:26.222438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:26.222438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:26.222438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:26.222438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:26.223284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:26.223284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:26.313703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:26.324666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3c842d09-b57b-4ee3-bc25-1cedae7b0eb6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1294 microversion: 2.1 time: 0.126875 Sep 23 01:35:26.325308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 345/690] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:26 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1294 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:26.910719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:26.921397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:26.921877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:26.922344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:26.934865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] Creating event network-changed:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:35:26.940568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-de4fd66d-2adb-4c23-a4e1-66b306ff6895 req-002a8e18-bdaf-4ea6-bfbd-cfe968d6f4b6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103758 Sep 23 01:35:26.941231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 346/691] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:26.971047 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:26.971680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:26.982455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:26.983508 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:26.985672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:26.987611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:26.989520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:26.989981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:27.297146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:27.309725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2193c140-5ec2-47d8-9344-13fcc643cb75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.342903 Sep 23 01:35:27.310332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 346/692] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:26 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:27.352913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:27.353809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:27.364760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:27.365264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:27.365768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:27.366526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:27.366992 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:27.367419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:27.742278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:27.754956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3586d19b-917f-4252-81fe-e84f2fbb39bf tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.406161 Sep 23 01:35:27.756496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 347/693] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:27 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:28.341492 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:28.342643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:28.357993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:28.358882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:28.359936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:28.361225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:28.362049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:28.362812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:28.537091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:28.538911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b47332af-9bee-41ee-bb86-f903477f3fcb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.207168 Sep 23 01:35:28.539498 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 347/694] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:28 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:28.784254 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:28.784995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:28.792297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:28.792832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:28.793306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:28.794124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:28.794615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:28.795090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:28.968865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1e50a2-07b1-4707-867a-4959d35ba7fa", "tag": "df0c17e3-2bae-45d1-9f8c-79208eb93e44"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:28.979506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:28.980040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:28.984856 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:28.994481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] Creating event network-changed:df0c17e3-2bae-45d1-9f8c-79208eb93e44 for instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa on hv-cinder-84914 Sep 23 01:35:29.001509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-92c1f44e-2e01-4f5e-80a1-af9f32a22913 req-1b1f3ca7-8d5d-4107-95ba-a8e55b304b36 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037458 Sep 23 01:35:29.003309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 348/695] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:29.026337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:29.034600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7206ca19-f9e3-4f90-b04b-9349ffff9ea7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.254975 Sep 23 01:35:29.035199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 348/696] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:28 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:29.278577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "name": "network-vif-plugged", "status": "completed", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:29.294807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:29.295287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:29.295760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:29.307501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] Creating event network-vif-plugged:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:35:29.313411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-dabb24d4-2a03-4977-8bf6-dcd91ab1a814 req-33a7c896-c4e4-43f6-8e65-47ff07b68cdb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038918 Sep 23 01:35:29.314069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 349/697] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:29.563303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:29.564091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:29.566373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:29.571690 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:29.572225 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:29.572728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:29.573449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:29.574600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:29.575665 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:29.796025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:29.804477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0fb9b77d-d024-4219-b207-77b13b7db633 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.245603 Sep 23 01:35:29.805065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 349/698] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:29 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:30.058696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:30.059359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:30.065621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:30.066162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:30.066598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:30.067283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:30.067762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:30.068242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:30.206707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:30.215400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a47123ea-90d9-4328-9f24-58d5c6c32022 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.160881 Sep 23 01:35:30.215992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 350/699] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:30 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:30.832836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:30.833942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:30.843043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:30.843760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:30.844333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:30.845660 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:30.846465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:30.847031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:31.014078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:31.021996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9d5300f5-9761-4bc5-a3bd-265b0df12e72 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.196753 Sep 23 01:35:31.022568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 350/700] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:30 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:31.238876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:31.239589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:31.244462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:31.250065 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:31.250551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:31.250985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:31.255266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:31.255266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:31.255266 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:31.268010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:31.393658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:31.401961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-267665f5-5442-414b-8728-0f29f239b9de tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.166884 Sep 23 01:35:31.402549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 351/701] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:31 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:32.049693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:32.050688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:32.063917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:32.064926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:32.065713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:32.067057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:32.067969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:32.068749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:32.312618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:32.321237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-011766a9-82cb-4a97-900d-1c2e2717d679 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1258 microversion: 2.1 time: 0.278983 Sep 23 01:35:32.321822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 351/702] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:32 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1258 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:32.425683 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:32.426282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:32.428848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=14 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:32.435915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:32.436547 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:32.437106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:32.438001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:32.438565 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:32.439085 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:32.612970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:32.622575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-394ff19c-1f5d-4981-82c7-e17026e06dfb tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.200627 Sep 23 01:35:32.623173 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 352/703] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:32 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:33.347048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:33.347927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:33.356395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.356894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.357445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.358500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.359185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.359777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.542428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:33.550667 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f1d2cf5a-da71-4dce-a239-55cce671a14a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1441 microversion: 2.1 time: 0.208851 Sep 23 01:35:33.551257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 352/704] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:33 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1441 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:33.575305 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:33.575967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:33.591973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.592464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.592908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.593624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.594081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.594506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.653531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:33.654516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:33.665133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.666024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.666838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.668393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:33.669419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:33.670370 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:33.701465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=100 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:33.816209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:33.832690 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-346ca6dd-b1f4-4902-8ea4-2f6d1afdb579 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1441 microversion: 2.1 time: 0.262144 Sep 23 01:35:33.833752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 353/705] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:33 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1441 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:33.898798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:33.914740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-73d23e09-59cd-46fd-bbf9-60eae03a082f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.268948 Sep 23 01:35:33.915649 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 353/706] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:33 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:34.954717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:34.955513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:34.963123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:34.963543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:34.964012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:34.965264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:34.965843 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:34.966137 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:35.381932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:35.392667 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-223fa5cb-91f5-4d6f-85a6-7953a37fad38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.441823 Sep 23 01:35:35.393273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 354/707] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:34 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:36.421112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:36.421939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:36.431520 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:36.432381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:36.433529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:36.434341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:36.434901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:36.435666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:36.663106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:36.674898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-be0a26f5-e55a-4c2a-bfbd-aa61ba707fe7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.258972 Sep 23 01:35:36.675651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 354/708] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:36 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:37.454828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1e50a2-07b1-4707-867a-4959d35ba7fa", "name": "network-vif-plugged", "status": "completed", "tag": "df0c17e3-2bae-45d1-9f8c-79208eb93e44"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:37.477078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.477804 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.480770 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:37.499693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] Creating event network-vif-plugged:df0c17e3-2bae-45d1-9f8c-79208eb93e44 for instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa on hv-cinder-84914 Sep 23 01:35:37.511386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-1aa5dd5c-668c-453e-976c-1b692945d60a req-3724b360-0126-49e4-86ae-178339732378 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064339 Sep 23 01:35:37.512988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 355/709] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:35:37.553584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:37.581811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.582654 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.583429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:37.599621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] Creating event network-changed:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:35:37.608281 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-b13d18ea-f3a7-46a7-98d7-ffe4cfbd5de6 req-5b1338b0-5be4-4415-a6e3-a8383dfd9f57 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.311045 Sep 23 01:35:37.613964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 355/710] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:37.729640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:37.731763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:37.753878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.757668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.758072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:37.759107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.760737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.762014 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:37.834244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:37.835318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:37.845545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.847246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.850443 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:37.854292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:37.855236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:37.856152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:38.020529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'services' on Instance uuid f742ca8a-d7be-4ca0-9277-3a5a44421160 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:38.358772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:38.370954 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c8b5700c-3070-4b79-a6b5-bfdc675461d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.656957 Sep 23 01:35:38.378671 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 356/711] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:37 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:38.408998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a3df39c6-2b3f-42ef-89dd-314be24c110e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments/9aeacf4f-5941-4fbf-a475-cdfb00877b17" status: 202 len: 0 microversion: 2.1 time: 0.580961 Sep 23 01:35:38.409656 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 356/712] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:35:37 2022] DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments/9aeacf4f-5941-4fbf-a475-cdfb00877b17 => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:35:38.418775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:38.424445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:38.431079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:38.431643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:38.432117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:38.432864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:38.433336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:38.433779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:38.471517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-313267d6-d1af-4cbc-8a0e-b84d7da0de78 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056902 Sep 23 01:35:38.472280 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 357/713] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:35:38 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:39.398071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:39.398855 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:39.408225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:39.408730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:39.409474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:39.410542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:39.411009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:39.411441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:39.485322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:39.487641 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:39.498107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:39.499011 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:39.499824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:39.501139 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:39.502020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:39.502828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:39.542995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c7108079-901b-4f88-9815-7529b5ee2df5 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061939 Sep 23 01:35:39.543774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 358/714] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:35:39 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:39.591091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:39.600670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-698bcc27-83ad-4e02-af4c-15aba1ae5298 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1362 microversion: 2.1 time: 0.208026 Sep 23 01:35:39.601545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 357/715] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:39 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:40.560401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:40.563867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:40.576716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.577553 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.578354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.579676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.580332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.581159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.622758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8dde5b1b-974d-4267-b5c9-d6120ba44967 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069232 Sep 23 01:35:40.623373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 359/716] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:35:40 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:40.632394 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:40.633461 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:40.643367 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.644003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.644499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.646224 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.646711 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.647154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.804420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:40.817868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6aa05cbf-3d00-4c35-950b-f12ffb9d7545 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1549 microversion: 2.1 time: 0.193172 Sep 23 01:35:40.817868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 358/717] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:40 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:40.841210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:40.842015 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:40.851209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.851746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.858077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.858077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:40.858077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:40.858077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:40.965494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-59542a66-c421-4ca3-89c7-50674d882441 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129742 Sep 23 01:35:40.966103 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 360/718] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:35:40 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:35:41.637662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:41.641583 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:41.649902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:41.650119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:41.650439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:41.651139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:41.652293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:41.652717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:41.685470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-165dd326-3ce3-4910-845b-405b7091bebf tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053219 Sep 23 01:35:41.686046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 359/719] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:35:41 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:35:41.777282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:41.777937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:41.783894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:41.784381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:41.784812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:41.785513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:41.785966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:41.786569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:41.818222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:35:42.099686 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1e50a2-07b1-4707-867a-4959d35ba7fa", "tag": "df0c17e3-2bae-45d1-9f8c-79208eb93e44"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:42.110837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:42.111455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:42.112175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:42.115934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4152cf14-3646-4ae7-a8d9-eba01b256582 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 204 len: 0 microversion: 2.1 time: 0.342122 Sep 23 01:35:42.115934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 361/720] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:35:41 2022] DELETE /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:35:42.124814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:42.125523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:42.128387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] Creating event network-changed:df0c17e3-2bae-45d1-9f8c-79208eb93e44 for instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa on hv-cinder-84914 Sep 23 01:35:42.133649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-ad49064c-8f1d-4f11-8cdd-9fe4dfe875cf req-ccb896cb-ef9c-4e73-9a8d-1fd7596d8c0c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Sep 23 01:35:42.134503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 360/721] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:35:42.135972 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:42.136652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:42.137002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:42.138173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:42.138800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:42.139265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:42.305754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:42.317789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ae7d9a72-50d2-4d38-8b07-4d1ea3982b26 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1689 microversion: 2.1 time: 0.197638 Sep 23 01:35:42.318861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 362/722] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:42 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1689 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:43.344506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:43.349632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:43.352871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:43.353390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:43.353992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:43.354530 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:43.354991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:43.355419 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:43.513649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:43.521802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c96d3b1d-1651-4c6a-8df3-17b6d39a4b52 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1689 microversion: 2.1 time: 0.181890 Sep 23 01:35:43.522392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 361/723] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:43 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:44.545504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:44.546053 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:44.553028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:44.553527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:44.553944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:44.554751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:44.555519 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:44.555715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:44.694575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:44.704775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-eb5b170e-4e11-4eaf-b9ab-09727a2716f6 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1689 microversion: 2.1 time: 0.163235 Sep 23 01:35:44.705416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 363/724] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:44 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:45.728903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:45.729659 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:45.737766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:45.738251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:45.738685 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:45.739392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:45.739872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:45.740293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:45.905748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:45.915896 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e6a41282-1af0-4c6b-8680-a653b13bd979 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1689 microversion: 2.1 time: 0.190857 Sep 23 01:35:45.916693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 362/725] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:45 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:46.944993 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:46.945791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:46.953717 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:46.954318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:46.954770 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:46.955492 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:46.955986 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:46.956405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:47.193916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:47.204768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e803e1be-7762-4e1d-890f-26149896ca27 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1689 microversion: 2.1 time: 0.263605 Sep 23 01:35:47.205383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 364/726] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:46 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1689 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:35:47.711571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f742ca8a-d7be-4ca0-9277-3a5a44421160", "name": "network-vif-deleted", "tag": "c77b59ee-17b3-4900-9eab-5cda9d09251b"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:47.722734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:47.722992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:47.724114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:47.739126 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] Creating event network-vif-deleted:c77b59ee-17b3-4900-9eab-5cda9d09251b for instance f742ca8a-d7be-4ca0-9277-3a5a44421160 on hv-cinder-84914 Sep 23 01:35:47.744858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-edd1c815-01b5-4556-8b18-8ca05914a06b req-ce738251-dc01-4a8b-84e2-8fad706bce4b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037684 Sep 23 01:35:47.745801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 363/727] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:48.242278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:48.243946 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:48.251027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:48.252174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:48.252442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:48.253454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:48.254017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:48.254457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:48.290591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:48.291227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:48.291864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:48.292327 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'fault' on Instance uuid f742ca8a-d7be-4ca0-9277-3a5a44421160 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:48.347357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:48.355642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-742df259-3a92-4f0a-b7aa-5bcc18fec71e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 200 len: 1334 microversion: 2.1 time: 0.119331 Sep 23 01:35:48.367575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 365/728] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:48 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 1334 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:49.381985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:49.384769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: f742ca8a-d7be-4ca0-9277-3a5a44421160] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:49.390917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:49.391403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:49.391866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:49.392570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:49.393044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:49.393447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:49.408368 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] HTTP exception thrown: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Request method failure captured: Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 HTTP/1.1 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYBYfcTzkvR_x_fgIoxQGBOVYevi2Zp0PQLNN5Adxub1momkDvhIUnyFD_xKYjC8o2mSrGKkiNqU7YlOSJNrmN9iRcrS5T9B-cW3MfIfRBifWzhuUFzwbGBgz-iR7DgoI3fh3hU9AO84ILe7Fwq53zwDcFXPnC_TPq0HyQXNH8MCc Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:35:49.410015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b8939e407ff4bdc81191af7f0593cd5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: da9978cab3fb4bdda39a2e4718ee2cc7 Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. Sep 23 01:35:49.411603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'f742ca8a-d7be-4ca0-9277-3a5a44421160'} Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:35:49.412522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. Sep 23 01:35:49.413993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:35:49.415395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Returning 404 to user: Instance f742ca8a-d7be-4ca0-9277-3a5a44421160 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:35:49.415395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b3fb8967-b40b-4d97-b1eb-9a23a035e390 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160" status: 404 len: 111 microversion: 2.1 time: 0.034213 Sep 23 01:35:49.415395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 364/729] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:49 2022] GET /compute/v2.1/servers/f742ca8a-d7be-4ca0-9277-3a5a44421160 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:35:49.421336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-635bb0d4-4165-4053-acaa-d4de29b3c89c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '.version_select at 0x7f7679004e50>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:49.618939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-635bb0d4-4165-4053-acaa-d4de29b3c89c tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-46232254" status: 202 len: 0 microversion: 2.1 time: 0.202021 Sep 23 01:35:49.619577 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 366/730] 10.222.0.64 () {58 vars in 1215 bytes} [Fri Sep 23 01:35:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-46232254 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:35:53.610541 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:53.611457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:53.613303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:53.618472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:53.618970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:53.619412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:53.620818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:53.621284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:53.621713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:53.652383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:35:53.974387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-017f1b17-86aa-452d-a994-c2026d1af682 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 204 len: 0 microversion: 2.1 time: 0.368517 Sep 23 01:35:53.975014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 365/731] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:35:53 2022] DELETE /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:35:53.985129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:53.985829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:53.992540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:53.993036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:53.993476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:53.994295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:53.994685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:53.995316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:54.150902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:54.160045 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6184e481-b912-46db-bd7b-8c29c1748735 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1509 microversion: 2.1 time: 0.180485 Sep 23 01:35:54.160642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 367/732] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:53 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1509 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:55.184108 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:55.184860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:55.192050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:55.192544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:55.192981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:55.193708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:55.194164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:55.194588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:55.345830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:55.354758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2a369ff7-0350-4303-9c6c-1bf0ab9398c8 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1509 microversion: 2.1 time: 0.175523 Sep 23 01:35:55.355432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 366/733] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:55 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:56.380287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:56.380923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:56.389515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:56.390016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:56.390454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:56.391187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:56.391839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:56.392259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:56.739217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:56.748955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6e3464b0-935e-47db-9cb0-2b204823a077 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1509 microversion: 2.1 time: 0.372669 Sep 23 01:35:56.749562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 368/734] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:56 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1509 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:57.105013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3604d0-0f5e-4363-ae25-1fa0bbbb900f", "name": "network-vif-deleted", "tag": "3c1b60d8-8221-4813-9c15-069d1c74ae40"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:35:57.116395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:57.116881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:57.117359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:57.131672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] Creating event network-vif-deleted:3c1b60d8-8221-4813-9c15-069d1c74ae40 for instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f on hv-cinder-84914 Sep 23 01:35:57.146430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e226fc08-5291-4f8a-9b0f-a2bbcc3e90ea req-ec26184d-57c7-4efc-917f-63022499f360 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044276 Sep 23 01:35:57.147423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 367/735] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:35:57.773912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:57.775175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:57.782168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:57.782666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:57.783128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:57.783888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:57.784364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:57.784778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:57.831842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:57.832745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:57.833542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:57.834369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'fault' on Instance uuid 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:57.881049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:57.883702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:57.891828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8e67c269-5f30-47fd-8bc9-3cc900ca8d37 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1312 microversion: 2.1 time: 0.122143 Sep 23 01:35:57.892430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 369/736] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:57 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:35:58.917720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:35:58.918464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:35:58.925288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:58.925785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:58.926219 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:58.926935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:58.927397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:58.927931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:58.969817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:35:58.970302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:35:58.970998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:35:58.971520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'fault' on Instance uuid 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:35:59.038986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:35:59.042558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:35:59.052989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4155ec9c-4cea-47c1-b402-eee52b5ae9b1 tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 200 len: 1312 microversion: 2.1 time: 0.140409 Sep 23 01:35:59.054043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 368/737] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:35:58 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 1312 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:00.076752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:00.077502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:00.085374 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.085855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.086295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.087000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.087455 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.094950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.103213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] HTTP exception thrown: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Request method failure captured: Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f HTTP/1.1 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwYBYfcTzkvR_x_fgIoxQGBOVYevi2Zp0PQLNN5Adxub1momkDvhIUnyFD_xKYjC8o2mSrGKkiNqU7YlOSJNrmN9iRcrS5T9B-cW3MfIfRBifWzhuUFzwbGBgz-iR7DgoI3fh3hU9AO84ILe7Fwq53zwDcFXPnC_TPq0HyQXNH8MCc Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:36:00.105416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b8939e407ff4bdc81191af7f0593cd5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: da9978cab3fb4bdda39a2e4718ee2cc7 Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. Sep 23 01:36:00.107211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '8e3604d0-0f5e-4363-ae25-1fa0bbbb900f'} Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:36:00.108052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. Sep 23 01:36:00.109236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:00.110287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Returning 404 to user: Instance 8e3604d0-0f5e-4363-ae25-1fa0bbbb900f could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:36:00.110287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-be9f49a7-b7a9-4847-9fde-28a99f5012df tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f" status: 404 len: 111 microversion: 2.1 time: 0.034187 Sep 23 01:36:00.110287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 370/738] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:00 2022] GET /compute/v2.1/servers/8e3604d0-0f5e-4363-ae25-1fa0bbbb900f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:36:00.116216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:00.116867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:00.124704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.125179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.125609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.126297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.126741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.127153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.153365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:36:00.500083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8888502d-3bdb-441f-8160-0587d630ceba tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 204 len: 0 microversion: 2.1 time: 0.387355 Sep 23 01:36:00.500679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 369/739] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:36:00 2022] DELETE /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:36:00.509351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:00.509962 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:00.516787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.518812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.518812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.518812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:00.519111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:00.519336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:00.669084 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:00.677289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-793e9886-c13a-4d8a-9c78-c19aeef3548a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.172118 Sep 23 01:36:00.677865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 371/740] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:00 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:01.705483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:01.706781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:01.718906 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:01.719826 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:01.720889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:01.722193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:01.723039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:01.723870 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:01.909292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:01.920067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c58c34d6-cc73-4e76-bd98-91605f4e0fae tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.222350 Sep 23 01:36:01.920807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 370/741] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:01 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:02.945367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:02.945984 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:02.948563 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:02.953953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:02.954538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:02.955134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:02.955921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:02.956478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:02.957143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:03.137001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:03.145436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-42a37dc1-db7f-4a99-981b-98903aebc25a tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1522 microversion: 2.1 time: 0.203938 Sep 23 01:36:03.146031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 372/742] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:02 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:04.103819 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75f4424-87db-4f88-a745-e8071a1a3404", "name": "network-vif-deleted", "tag": "fbe29d32-612d-4c37-bdda-6d63f1cd6de4"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:04.122629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:04.123487 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:04.124273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:04.145183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] Creating event network-vif-deleted:fbe29d32-612d-4c37-bdda-6d63f1cd6de4 for instance a75f4424-87db-4f88-a745-e8071a1a3404 on hv-cinder-84914 Sep 23 01:36:04.150298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-ab9597ae-0752-450a-a402-eeac620aa54b req-d6e0bb13-45c7-43be-acba-95f7082f8d3e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050194 Sep 23 01:36:04.151011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 371/743] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:36:04.169972 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:04.170783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:04.178217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:04.178706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:04.179148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:04.179887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:04.180351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:04.180812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:04.267955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:04.277466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-68d2566e-35dd-4e5d-ac00-05d13017100e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1480 microversion: 2.1 time: 0.110969 Sep 23 01:36:04.278026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 373/744] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:04 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1480 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:05.303984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:05.304856 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:05.314337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:05.314886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:05.315415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:05.316256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:05.316744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:05.317217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:05.356123 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:05.356518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:05.356953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:05.357415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lazy-loading 'fault' on Instance uuid a75f4424-87db-4f88-a745-e8071a1a3404 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:36:05.404415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'da9978cab3fb4bdda39a2e4718ee2cc7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b8939e407ff4bdc81191af7f0593cd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:05.416164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8bd5ebeb-d4f7-4824-a777-7db6f0e33a1d tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 200 len: 1312 microversion: 2.1 time: 0.117660 Sep 23 01:36:05.417586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 372/745] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:05 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 1312 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:36:06.450890 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:06.450890 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] [instance: a75f4424-87db-4f88-a745-e8071a1a3404] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:06.459104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:06.459814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:06.460389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:06.461169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:06.461719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:06.462210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:06.486638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] HTTP exception thrown: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Request method failure captured: Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 HTTP/1.1 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwYBYfcTzkvR_x_fgIoxQGBOVYevi2Zp0PQLNN5Adxub1momkDvhIUnyFD_xKYjC8o2mSrGKkiNqU7YlOSJNrmN9iRcrS5T9B-cW3MfIfRBifWzhuUFzwbGBgz-iR7DgoI3fh3hU9AO84ILe7Fwq53zwDcFXPnC_TPq0HyQXNH8MCc Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:36:06.489815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1b8939e407ff4bdc81191af7f0593cd5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1b8939e407ff4bdc81191af7f0593cd5", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 1b8939e407ff4bdc81191af7f0593cd5 Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1142306427 Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: da9978cab3fb4bdda39a2e4718ee2cc7 Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1142306427-project Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. Sep 23 01:36:06.491491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'a75f4424-87db-4f88-a745-e8071a1a3404'} Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:36:06.492403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. Sep 23 01:36:06.497929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:36:06.499209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] Returning 404 to user: Instance a75f4424-87db-4f88-a745-e8071a1a3404 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:36:06.499209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-376ba4be-58c2-4d1f-a023-544f6a410f8e tempest-ServerRescueNegativeTestJSON-1142306427 tempest-ServerRescueNegativeTestJSON-1142306427-project] 10.222.0.64 "GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404" status: 404 len: 111 microversion: 2.1 time: 0.047182 Sep 23 01:36:06.499209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 374/746] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:36:06 2022] GET /compute/v2.1/servers/a75f4424-87db-4f88-a745-e8071a1a3404 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:36:10.944036 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:10.944813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:10.952125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:10.952623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:10.953061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:10.953786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:10.954478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:10.954911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:11.000590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b2501cb0-379e-49b5-ac92-e1973315259d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/ips" status: 200 len: 152 microversion: 2.20 time: 0.061715 Sep 23 01:36:11.002191 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 373/747] 10.222.0.64 () {60 vars in 1289 bytes} [Fri Sep 23 01:36:10 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 23 01:36:13.562945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:13.563569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:13.570162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:13.570658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:13.571096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:13.571877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:13.572337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:13.572765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:13.598323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'flavor' on Instance uuid bce51dee-2d0e-4c4c-9517-63a261f63950 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:36:14.197768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4036541a-381c-48b8-af04-f9901b2a9fc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/action" status: 202 len: 0 microversion: 2.20 time: 0.638645 Sep 23 01:36:14.198390 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 375/748] 10.222.0.64 () {62 vars in 1319 bytes} [Fri Sep 23 01:36:13 2022] POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:36:14.206755 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:14.207344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:14.215256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:14.215791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:14.216233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:14.216950 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:14.217412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:14.217885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:14.402936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:14.412561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:14.414537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:14.419348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-72638881-030f-4ea2-a0e4-8eaf7ede71c4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.213064 Sep 23 01:36:14.419348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 374/749] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:14 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:36:15.453058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:15.453960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:15.461440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:15.461942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:15.462379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:15.463162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:15.464194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:15.464663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:15.628638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:15.640467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:15.640467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:15.640467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-37400528-038d-4685-a3e7-62f0203d8872 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.191975 Sep 23 01:36:15.640863 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 376/750] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:15 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:16.666867 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:16.667758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:16.674717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:16.675241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:16.675732 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:16.676509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:16.676988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:16.677390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:16.824337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:16.833124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:16.834571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:16.835783 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fa4683ce-7504-42ce-ab02-f2e6bef8995e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.173291 Sep 23 01:36:16.836343 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 375/751] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:16 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:17.867148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:17.867815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:17.874899 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:17.875393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:17.875998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:17.876713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:17.877206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:17.877632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:18.054180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:18.064092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:18.068035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:18.068035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0281636b-a4b9-4ba2-853b-55d9533c88c8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.203766 Sep 23 01:36:18.068035 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 377/752] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:17 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:19.094178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:19.095359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:19.108658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:19.110588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:19.110588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:19.111395 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:19.111989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:19.112521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:19.267914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:19.276221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:19.277672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:19.278859 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ccc6255f-4c79-48a9-b2e3-745411ba012b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.190168 Sep 23 01:36:19.279427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 376/753] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:19 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:20.305917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:20.306646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:20.314758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:20.315253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:20.315741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:20.316472 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:20.316933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:20.317365 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:20.473322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:20.482738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:20.484217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:20.485491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2bc26ea3-f52c-4e6d-b9a3-4be6a9c4a5f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.185041 Sep 23 01:36:20.486043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 378/754] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:20 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:21.512236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:21.512796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:21.519682 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:21.520171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:21.520602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:21.521302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:21.521756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:21.522182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:21.673947 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:21.682951 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:21.684451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:21.685613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ad72e8f8-3e86-484f-ba73-e091c9bdb4b7 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.177656 Sep 23 01:36:21.686207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 377/755] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:21 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:22.710858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:22.711484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:22.718828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:22.719332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:22.719814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:22.720531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:22.721423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:22.721662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:22.854163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:22.863801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:22.865272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:22.866493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b82a1a5b-82a5-4bae-8907-260a2c831e51 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.159657 Sep 23 01:36:22.867085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 379/756] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:22 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:36:23.892078 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:23.892676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:23.895340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:23.900233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:23.900713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:23.901138 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:23.901824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:23.902270 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:23.902730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:24.044778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:24.053221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:24.054698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:24.055920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ea543a9b-b60f-46a3-b947-adc1fdd20f0e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.167846 Sep 23 01:36:24.056480 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 378/757] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:23 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:25.081730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:25.082402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:25.089059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:25.089562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:25.090009 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:25.090705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:25.091162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:25.091645 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:25.230334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:25.239913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:25.241375 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:25.242551 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8071d9cb-4be9-4faa-a04b-66cd81e54b79 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.164781 Sep 23 01:36:25.243111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 380/758] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:25 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:25.996382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:25.996993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:26.004442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:26.004927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:26.005539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:26.006256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:26.006715 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:26.007136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:26.039672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dbeaac33-ad3c-4780-b137-59945e4b9a11 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/ips" status: 200 len: 146 microversion: 2.1 time: 0.047174 Sep 23 01:36:26.040459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 379/759] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:36:25 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/ips => generated 146 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:26.271386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:26.272379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:26.281131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:26.281879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:26.282430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:26.283199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:26.283748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:26.289249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:26.437325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:26.447503 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:26.449845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:26.451335 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cd7bb332-b2b1-41c0-b632-559d1eee03d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.185219 Sep 23 01:36:26.452056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 381/760] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:26 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:27.485844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:27.486460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:27.493745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:27.494263 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:27.494689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:27.496285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:27.496959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:27.497511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:27.637822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:27.646694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:27.655253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:27.655253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f28c061d-a876-4d7f-878d-e17e6cf807b9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.167688 Sep 23 01:36:27.655253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 380/761] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:27 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:27.854380 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43edfde7-2b83-4dbb-8e62-fbbe116af221"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:27.856799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:27.863604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:27.864089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:27.864527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:27.867147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:27.867147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:27.867147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:28.681499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:28.683277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:28.689875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:28.690357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:28.690917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:28.691640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:28.692092 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:28.692503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:28.770105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1f710639-ad69-4ce6-bcef-769c8eeb04f1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.919686 Sep 23 01:36:28.771071 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 382/762] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:36:27 2022] POST /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 194 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:28.853052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:28.854322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:28.855823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:28.857089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a1598bbe-9f35-46ee-9726-39cdf2b8840f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.184450 Sep 23 01:36:28.857662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 381/763] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:28 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:29.883613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:29.884441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:29.891919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:29.892436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:29.892880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:29.893593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:29.894080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:29.894505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:30.072537 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:30.082312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:30.083742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:30.084942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-180bb0ea-36c1-46f9-ae6d-7015410d95ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.206252 Sep 23 01:36:30.085516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 383/764] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:29 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:31.110435 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:31.110974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:31.117640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:31.118120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:31.118550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:31.119241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:31.120232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:31.120658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:31.123576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:31.257528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:31.265863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:31.267285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:31.268466 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dabfeb65-66fd-44f2-900a-ec44d9dc340f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.162073 Sep 23 01:36:31.269029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 382/765] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:31 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:32.293896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:32.294513 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:32.301657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:32.302185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:32.302622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:32.303331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:32.303821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:32.304251 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:32.309527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:32.452713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:32.461988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:32.463627 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:32.464854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9225add6-57f0-44c8-89cc-dca6f9406ff3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1746 microversion: 2.20 time: 0.174981 Sep 23 01:36:32.465437 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 384/766] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:32 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1746 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:33.492125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:33.492710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:33.500211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:33.500721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:33.501149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:33.501834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:33.502278 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:33.502696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:33.633406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:33.641774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:33.643216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:33.644409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2cec73ba-ccdd-4e19-b924-06c086b5e956 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1746 microversion: 2.20 time: 0.156461 Sep 23 01:36:33.644961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 383/767] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:33 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:34.669738 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:34.670356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:34.673022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=26 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:34.678010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:34.678510 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:34.678946 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:34.679874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:34.680749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:34.680749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:34.817169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:34.826298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:34.827767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:34.829005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0da582f-6f4a-424a-97de-76635542e6f3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.163337 Sep 23 01:36:34.830038 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 385/768] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:34 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:35.856596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:35.857206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:35.873804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:35.874618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:35.875121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:35.876087 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:35.876863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:35.877322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:36.085223 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:36.097778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:36.101748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:36.104534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-deac3b3c-1e9e-4bfb-b090-122e69332b0f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.252110 Sep 23 01:36:36.107247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 384/769] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:35 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:37.132672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:37.133272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:37.149547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:37.150056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:37.150521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:37.151247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:37.152118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:37.152764 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:37.402079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:37.421042 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:37.427995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:37.430633 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c6589066-6478-4a08-bc2d-4d4203cec093 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.302459 Sep 23 01:36:37.431211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 386/770] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:37 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:37.707651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "name": "network-vif-plugged", "status": "completed", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:37.724461 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:37.724979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:37.725816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:37.745259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] Creating event network-vif-plugged:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:36:37.759716 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-10e09687-139c-49c8-a794-b26755c05839 req-e92fc962-89b0-46fb-9ca4-9537bb108293 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235930 Sep 23 01:36:37.761973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 385/771] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:36:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:38.458743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:38.460541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:38.469916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:38.471224 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:38.472056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:38.473112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:38.473872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:38.474544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:38.712994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:38.729640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:38.732629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:38.735052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7b953459-6da7-41f6-aaf4-0b22995c87d4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.280429 Sep 23 01:36:38.749060 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 387/772] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:38 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:39.769080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:39.770959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:39.782606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.783723 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.783723 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:39.786803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.787474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.788341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:39.821486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:39.826542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:39.839772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.846759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.846759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:39.846759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.846759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.847629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:39.914175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3d9908bf-737c-47fa-b3aa-05d109c17426 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100906 Sep 23 01:36:39.914831 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 388/773] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:36:39 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:39.929822 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:39.931262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:39.941509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.942941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.949627 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:39.951927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:39.952979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:39.953725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:40.003693 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:40.009382 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ee29b460-6888-4e36-864b-e811541d7a9f tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221" status: 200 len: 194 microversion: 2.1 time: 0.084219 Sep 23 01:36:40.010839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 389/774] 10.222.0.64 () {58 vars in 1413 bytes} [Fri Sep 23 01:36:39 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:40.019156 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:40.021049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:40.022573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-062d686c-d39e-40f5-b36c-ac1ec6278009 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.259649 Sep 23 01:36:40.025011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 386/775] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:39 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:41.052281 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:41.052675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:41.073553 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:41.074519 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:41.075019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:41.075823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:41.076369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:41.076807 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:41.318812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:41.333860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:41.335805 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:41.337249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0e7f1cf6-ffda-4828-831d-61916f601f0d tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.289587 Sep 23 01:36:41.337878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 390/776] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:41 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:42.027311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "177ec497-4cf9-438a-b76e-57d84e3051da"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:42.031427 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:42.039651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:42.040536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:42.041837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:42.042841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:42.043397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:42.044080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:42.370040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:42.370786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:42.378972 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:42.379505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:42.380183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:42.380905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:42.381362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:42.381787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:42.539360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:42.548830 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:42.550328 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:42.552474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-874df9be-2d00-4452-a942-6757e3cf5a92 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.186174 Sep 23 01:36:42.552474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 391/777] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:42 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:36:43.541190 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ef7b5b85-7e7d-4928-bd6e-9d923187acea tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "POST /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.519035 Sep 23 01:36:43.548386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 387/778] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:36:42 2022] POST /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 194 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:43.578811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:43.580210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:43.596387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:43.599188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:43.601869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:43.603310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:43.607916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:43.608681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:43.866677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:43.880452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:43.885089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:43.887378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ffdf13ff-594a-4d98-8df7-f8a3b26f90eb tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.312341 Sep 23 01:36:43.889109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 392/779] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:43 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:44.927116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:44.928209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:44.948804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:44.949523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:44.950088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:44.951142 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:44.951782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:44.952406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:45.143256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:45.158276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:45.160803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:45.163162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-546d9692-9611-483a-b6eb-1d0ef7f6ef6f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.246483 Sep 23 01:36:45.179578 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 388/780] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:44 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:46.203076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:46.203076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:46.210001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:46.210835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:46.211279 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:46.212109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:46.213300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:46.214651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:46.690133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:46.699317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:46.700823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:46.702004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a15521dd-debd-4676-867a-2dc2cfb0fd94 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.507077 Sep 23 01:36:46.702575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 393/781] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:46 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:47.727996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:47.729141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:47.736035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:47.736582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:47.737025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:47.737736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:47.738187 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:47.738612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:47.891158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:47.900177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:47.901647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:47.902803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4f9cfca5-c713-4575-be5f-2c2692cfa667 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1741 microversion: 2.20 time: 0.179008 Sep 23 01:36:47.903376 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 389/782] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:47 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:48.929490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:48.930138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:48.937133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:48.937639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:48.938082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:48.938806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:48.939307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:48.939774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:49.204977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:49.214406 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:49.216075 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:49.217149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e236396f-b919-43ab-9117-e71d2d92373b tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1723 microversion: 2.20 time: 0.291880 Sep 23 01:36:49.217733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 394/783] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:48 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1723 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:50.244302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:50.245105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:50.251808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:50.252214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:50.252734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:50.253449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:50.253907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:50.254331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:50.396829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:50.406502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:50.408059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:50.409443 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6b6d2c93-847f-4445-bd88-9e003fca83bd tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1723 microversion: 2.20 time: 0.169088 Sep 23 01:36:50.409915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 390/784] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:50 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:51.437637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:51.438300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:51.446111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:51.446600 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:51.447043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:51.448425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:51.448887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:51.449314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:51.609523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:51.618684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:51.621101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:51.622304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c994f82a-3fe6-414f-ae05-fb9eadeefa44 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1726 microversion: 2.20 time: 0.188807 Sep 23 01:36:51.622861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 395/785] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:51 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1726 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:36:51.649203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36250c76-dbde-464d-bc56-4c1ca5dbc682"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:51.651949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:51.659279 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:51.659858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:51.660366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:51.661110 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:51.661615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:51.662097 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.427512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:52.431504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:52.443779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.445278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.445786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.446541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.447966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.448575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.488919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-547b0424-7e6c-4878-8282-b099e86fdc5e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.065622 Sep 23 01:36:52.489565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 396/786] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:36:52 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:36:52.637291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:52.637793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:52.645421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.645909 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.646532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.647235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.647720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.648144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.702269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1db0719f-fc90-4e26-b638-93527a7775f3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221" status: 200 len: 194 microversion: 2.1 time: 0.071277 Sep 23 01:36:52.703291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 397/787] 10.222.0.64 () {58 vars in 1413 bytes} [Fri Sep 23 01:36:52 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:36:52.714575 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:52.715109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:52.722331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.722919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.723269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:52.724028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:52.724491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:52.724919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:53.024861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'services' on Instance uuid 4e1e50a2-07b1-4707-867a-4959d35ba7fa {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:36:53.070074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4adc830e-2c16-43c3-8be1-c689c831e808 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.424880 Sep 23 01:36:53.071404 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 391/788] 10.222.0.64 () {62 vars in 1364 bytes} [Fri Sep 23 01:36:51 2022] POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments => generated 188 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 23 01:36:53.359116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e78b68c6-ff5a-4ddf-a80f-8199f7a552ef tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221" status: 202 len: 0 microversion: 2.1 time: 0.648345 Sep 23 01:36:53.360282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 398/789] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:36:52 2022] DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/43edfde7-2b83-4dbb-8e62-fbbe116af221 => generated 0 bytes in 650 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:36:53.389532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:53.389532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:53.389532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:53.389795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:53.390193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:53.390891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:53.391338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:53.392299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:53.448939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "name": "network-vif-unplugged", "status": "completed", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:53.463400 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:53.463962 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:53.464619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:53.477244 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.compute.server_external_events [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] Unable to find a host for instance bce51dee-2d0e-4c4c-9517-63a261f63950. Dropping event network-vif-unplugged {{(pid=121763) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 01:36:53.478159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-4bd9f08c-87ae-4003-a674-a8d5d3f6263d req-6ff3f878-673b-401c-a20c-7771d3aebaf2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033865 Sep 23 01:36:53.480795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 399/790] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 23 01:36:56.293966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=10,nova_cell1:INSERT=6 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:56.490117 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4985c801-6291-4f20-add0-fb6ee2b77852 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments/36250c76-dbde-464d-bc56-4c1ca5dbc682" status: 202 len: 0 microversion: 2.20 time: 3.120627 Sep 23 01:36:56.490680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 392/791] 10.222.0.64 () {60 vars in 1457 bytes} [Fri Sep 23 01:36:53 2022] DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments/36250c76-dbde-464d-bc56-4c1ca5dbc682 => generated 0 bytes in 3122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:36:56.555399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:36:56.556161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:56.562841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:56.563325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:56.563798 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:56.564493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:56.564940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:56.565381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:56.708109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121763) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 01:36:56.819874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:57.098868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f97a7859-b0c5-4653-b483-33ae75795242 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/action" status: 202 len: 0 microversion: 2.20 time: 0.547315 Sep 23 01:36:57.099393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 400/792] 10.222.0.64 () {62 vars in 1319 bytes} [Fri Sep 23 01:36:56 2022] POST /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:36:57.108120 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:57.108832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:57.111913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=30 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:36:57.117340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:57.117824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:57.118545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:57.118545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:57.118545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:57.118545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:57.281329 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:57.293543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:57.296286 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:57.299958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-834f8c25-14dd-49eb-ab09-a249717b27b4 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1674 microversion: 2.20 time: 0.195979 Sep 23 01:36:57.301010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 393/793] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:57 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1674 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:36:58.328485 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:58.328983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:58.335906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:58.336463 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:58.336878 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:58.337565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:58.338016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:58.338438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:58.498741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:58.507306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:58.508802 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:58.510050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-80b5acd8-ada1-4893-8cdc-e86bb257b4f8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1674 microversion: 2.20 time: 0.186454 Sep 23 01:36:58.510661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 401/794] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:58 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1674 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:36:59.536250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:36:59.536845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:36:59.543714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:59.544206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:59.544636 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:59.545323 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:36:59.545776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:36:59.546192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:36:59.723272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:59.737933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:59.740759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:36:59.742878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6b3c5aaa-17d2-41ba-9b6e-21627deade3c tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1674 microversion: 2.20 time: 0.210458 Sep 23 01:36:59.744664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 394/795] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:36:59 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1674 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:00.770914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:00.771539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:00.778527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:00.779068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:00.779510 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:00.780253 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:00.780722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:00.781148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:00.971370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:00.973239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:00.986909 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:00.988031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:00.989075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:00.990825 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:00.992153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:00.995434 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:01.002369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:01.019183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:01.023479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:01.027425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-79171235-5b9e-4594-9e51-89eeb82949e8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.260398 Sep 23 01:37:01.040055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-89f593c7-7766-47f3-a954-b3184c717a15 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/177ec497-4cf9-438a-b76e-57d84e3051da" status: 200 len: 194 microversion: 2.1 time: 0.072094 Sep 23 01:37:01.041626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 402/796] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:00 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:01.045606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 395/797] 10.222.0.64 () {58 vars in 1413 bytes} [Fri Sep 23 01:37:00 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/177ec497-4cf9-438a-b76e-57d84e3051da => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:01.049606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:01.050110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:01.057184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:01.057680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:01.058119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:01.058941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:01.059408 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:01.059874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:01.172276 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'services' on Instance uuid 4e1e50a2-07b1-4707-867a-4959d35ba7fa {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:37:01.484257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-835953e2-fd60-4f42-b99d-95e11312342e tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/177ec497-4cf9-438a-b76e-57d84e3051da" status: 202 len: 0 microversion: 2.1 time: 0.438656 Sep 23 01:37:01.485269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 403/798] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:37:01 2022] DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments/177ec497-4cf9-438a-b76e-57d84e3051da => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:37:02.060657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:02.061276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:02.068456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:02.068946 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:02.070390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:02.070390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:02.070620 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:02.070966 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:02.215912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:02.224560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:02.227193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:02.229114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-70c97222-d47b-42a9-b5af-b594c200e4d9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.172390 Sep 23 01:37:02.243575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 396/799] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:02 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:02.883359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:02.888227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:02.895104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:02.896074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:02.896994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:02.898099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:02.898904 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:02.899736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:02.939910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-389ad092-8403-42d9-b371-48a1d0682ac6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062627 Sep 23 01:37:02.943832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 404/800] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:02 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:03.255643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:03.256887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:03.264798 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:03.265287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:03.265924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:03.266628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:03.267638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:03.267638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:03.449652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:03.459821 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:03.461677 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:03.472930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-15d2923a-2c9c-45f8-b61a-9cd0a85854c0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.221168 Sep 23 01:37:03.473587 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 397/801] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:03 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:03.956171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:03.958438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:03.968948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:03.979284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:03.980080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:03.980942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:03.981597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:03.982027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:04.037416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4fcedd00-ec04-4413-9c7f-5ba9125e8406 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086161 Sep 23 01:37:04.038322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 405/802] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:03 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:04.500761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:04.502091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:04.509884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:04.516409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:04.516841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:04.518043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:04.518043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:04.518438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:04.679145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:04.689602 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:04.691844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:04.693386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b2d190e7-5583-4190-bbb6-7402c30d437f tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.196623 Sep 23 01:37:04.712006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 398/803] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:04 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:37:05.053230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:05.056852 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:05.066194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:05.070484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:05.071056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:05.071651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:05.072887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:05.073351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:05.073786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:05.126088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-18ca5d6d-a803-4ab6-8a4f-4a1de0a339ee tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077742 Sep 23 01:37:05.127360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 406/804] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:05 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:05.733523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:05.734370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:05.744447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:05.745233 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:05.746116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:05.747446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:05.748365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:05.749165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:05.944541 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:05.954392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:05.955962 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:05.957699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6fa9bb8c-11d9-447c-b9c3-18c9d6fe8068 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.230712 Sep 23 01:37:05.959571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 399/805] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:05 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:06.140235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:06.143296 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:06.153121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:06.153632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:06.154079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:06.154805 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:06.155268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:06.155727 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:06.191976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2f938d78-6313-452c-9fdf-be09c7779c34 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055869 Sep 23 01:37:06.195796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 407/806] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:06 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:37:06.993151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:06.994804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:07.006552 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:07.007444 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:07.008280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:07.010963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:07.011236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:07.011986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:07.208356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:07.216896 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:07.230260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:07.242019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:07.243416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:07.245449 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:07.247082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:07.248142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:07.248887 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:07.250331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:07.251917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:07.253172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d797f5d3-2485-439b-8daa-b99adcdda44a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.267121 Sep 23 01:37:07.253760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 400/807] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:06 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:07.345311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1636eb8a-00dc-42da-a1a6-d50c61c776c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143220 Sep 23 01:37:07.353985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 408/808] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:07 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:08.304949 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:08.306945 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:08.314312 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:08.323631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:08.324089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:08.324855 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:08.325307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:08.325741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:08.359481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:08.363234 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:08.379234 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:08.379873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:08.380316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:08.383791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:08.383791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:08.383791 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:08.469685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5ee2410f-047a-41cd-bb3f-4f31e906d2c5 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089749 Sep 23 01:37:08.469685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 409/809] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:08 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:08.573309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:08.584290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:08.586151 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:08.588586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3752fb20-946d-4fa7-8726-414a89b088d3 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.286631 Sep 23 01:37:08.589177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 401/810] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:08 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:09.474535 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:09.476891 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:09.486967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:09.487903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:09.488571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:09.490173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:09.490933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:09.491642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:09.530778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9b761634-9401-4505-b9e9-d6ded8649168 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060812 Sep 23 01:37:09.531691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 410/811] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:09 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:09.618212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:09.620789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:09.630818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:09.632108 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:09.633053 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:09.633887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:09.636287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:09.637220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:10.016780 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:10.028696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:10.030422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:10.031764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3d4897d6-8d0c-41b1-abe4-5ad94565f6ce tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.420026 Sep 23 01:37:10.032746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 402/812] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:09 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:37:10.549744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:10.554138 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:10.568136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:10.569086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:10.569941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:10.571471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:10.578204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:10.578204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:10.656762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-db153bd0-5b82-43ee-abc3-47d9ea9d0ac2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112405 Sep 23 01:37:10.658731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 411/813] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:10 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:37:10.860734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:10.865381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:10.875979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:10.877026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:10.877866 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:10.879314 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:10.880240 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:10.881093 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:10.931238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a0de22e1-c5d1-41b6-9ddd-823359110cf6 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076244 Sep 23 01:37:10.932055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 403/814] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:37:10 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:37:11.000039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:11.000663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:11.007113 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.007639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.008080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.008781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.009760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.010191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.044122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:37:11.063703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:11.064518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:11.074506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.075145 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.075791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.076614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.077177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.077694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.256455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:11.265948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:11.267440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:11.268661 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-26d01635-4f58-498c-a70e-49601ca3016e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.209718 Sep 23 01:37:11.269462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 404/815] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:11 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:37:11.417495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d80981c8-4ae9-4c84-b92b-2ec3b2a377b1 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 204 len: 0 microversion: 2.1 time: 0.420826 Sep 23 01:37:11.418358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 412/816] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:37:10 2022] DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:37:11.428338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:11.433218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:11.436096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.436764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.437137 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.437853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:11.438332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:11.438761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:11.586589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:11.595180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c8bc0d2c-1ec8-48f3-b3e0-c0fe372dabcd tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.170741 Sep 23 01:37:11.613464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 405/817] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:11 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:12.295593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:12.296291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:12.305341 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:12.305839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:12.306284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:12.306996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:12.307466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:12.307929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:12.454845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:12.469856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:12.472315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:12.474589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b109559b-5677-464a-87fd-166fd75f6873 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.183284 Sep 23 01:37:12.475536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 413/818] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:12 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:12.620228 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:12.620838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:12.627862 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:12.628361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:12.628801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:12.629514 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:12.629979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:12.630405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:12.778477 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:12.787001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0a98954c-4cdb-4910-aef3-62d72ac66a53 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.170721 Sep 23 01:37:12.787597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 406/819] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:12 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:13.506762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:13.508471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:13.517463 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:13.518003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:13.518469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:13.519229 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:13.519840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:13.520356 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:13.523512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:13.676454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:13.685312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:13.686773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:13.687976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-60625b85-9080-4fe8-b3ec-982eb86e4703 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.186633 Sep 23 01:37:13.688571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 414/820] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:13 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:13.811158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:13.811712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:13.819364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:13.819900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:13.820364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:13.821116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:13.821554 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:13.822542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:13.962615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:13.970557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6d97da12-ecf9-4b17-b163-e0af451ac876 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.163447 Sep 23 01:37:13.971113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 407/821] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:13 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:14.714697 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:14.715289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:14.722310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:14.722799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:14.723233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:14.723970 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:14.724424 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:14.724851 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:14.866524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:14.875036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:14.876503 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:14.877749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0286ff35-7164-40ba-8a3b-421d14f7c7b6 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.167694 Sep 23 01:37:14.878312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 415/822] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:14 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:14.994687 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:14.995440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:15.002748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:15.003181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:15.003643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:15.004337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:15.004782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:15.005193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:15.155752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:15.164802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e8b7c9e8-ab4b-4e69-9d79-26b6ad4e0e38 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.173990 Sep 23 01:37:15.165392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 408/823] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:14 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:15.904427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:15.905200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:15.911895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:15.912384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:15.912819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:15.913548 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:15.913976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:15.914396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:16.089457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:16.107155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:16.110522 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:16.113008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bf39e4cf-6d98-4ef7-a705-732f1034da19 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.212847 Sep 23 01:37:16.114087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 416/824] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:15 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:16.193291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:16.194150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:16.202577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:16.203159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:16.203734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:16.204442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:16.204957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:16.205378 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:16.228094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=100 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:16.362322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:16.371066 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fd376b90-0f20-45fc-982b-a315d3b969d9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.183022 Sep 23 01:37:16.372087 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 409/825] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:16 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:17.144704 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:17.145833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:17.158799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:17.159823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:17.160624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:17.162105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:17.162964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:17.163745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:17.398194 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:17.401391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:17.408756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:17.409245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:17.409846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:17.410551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:17.411018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:17.411655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:17.530471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:17.544721 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:17.546498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:17.547950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9f60669f-68a0-49f9-8280-c188af0752b0 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.411048 Sep 23 01:37:17.548836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 417/826] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:17 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:17.613439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:17.625072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9315f43a-295f-44e1-b10f-603d2dceedc2 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1673 microversion: 2.1 time: 0.233157 Sep 23 01:37:17.626768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 410/827] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:17 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1673 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:18.052484 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1e50a2-07b1-4707-867a-4959d35ba7fa", "name": "network-vif-deleted", "tag": "df0c17e3-2bae-45d1-9f8c-79208eb93e44"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:18.073047 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.073914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.074706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.107175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] Creating event network-vif-deleted:df0c17e3-2bae-45d1-9f8c-79208eb93e44 for instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa on hv-cinder-84914 Sep 23 01:37:18.116921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-19d11856-a3c1-4468-a8ed-ee189c69d092 req-51dac3f9-71a0-4faf-901d-f7b9037a4fea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072881 Sep 23 01:37:18.120612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 418/828] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:18.583703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:18.586170 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:18.599511 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.600425 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.601501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.602582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.603387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.603925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.662647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:18.664111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:18.671663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.672421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.673056 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.673960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.674587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.675325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.715679 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:18.716096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:18.733457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:18.733457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lazy-loading 'fault' on Instance uuid 4e1e50a2-07b1-4707-867a-4959d35ba7fa {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:37:18.766830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:18.768547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1633ea35eda34ffe884140eaab1ae909', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92e9b7f9904f437f91148da9fc521326', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:18.779333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:18.781886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:18.783430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f0ad7f0a-ea14-49b2-9204-f26690736258 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.207546 Sep 23 01:37:18.784466 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 411/829] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:18 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:18.791208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f8b2a978-a8a7-45a8-a94a-a64aedd1a141 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 200 len: 1326 microversion: 2.1 time: 0.132698 Sep 23 01:37:18.799443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 419/830] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:18 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 1326 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:19.638775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "name": "network-vif-plugged", "status": "completed", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:19.649934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:19.650938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:19.651366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:19.664075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] Creating event network-vif-plugged:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:37:19.670600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-f40fe86e-628f-499c-adf6-81c88c652567 req-93369a48-adeb-4c0b-afdd-8118cd0301d2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035564 Sep 23 01:37:19.671370 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 412/831] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:37:19.820245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:19.820631 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:19.821526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:19.822995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:19.829769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:19.831694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:19.832451 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:19.833571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:19.834453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:19.835273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:19.842595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:19.844711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:19.845654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:19.847735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:19.849053 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:19.851238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:19.859863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa HTTP/1.1 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:19.861590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:19.863995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '4e1e50a2-07b1-4707-867a-4959d35ba7fa'} Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:19.865960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:19.868815 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:19.871280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:19.871280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-09ddcf19-f28f-482e-9101-7b4dece5eff3 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 404 len: 111 microversion: 2.1 time: 0.049124 Sep 23 01:37:19.871280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 413/832] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:19 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:37:19.873286 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-17502ee9-0f98-466f-b069-d3d8fe8d6216 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '.version_select at 0x7f7678f3d3a0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:20.059960 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:20.066028 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-17502ee9-0f98-466f-b069-d3d8fe8d6216 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-243580435" status: 202 len: 0 microversion: 2.1 time: 0.197011 Sep 23 01:37:20.067399 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 414/833] 10.222.0.64 () {58 vars in 1218 bytes} [Fri Sep 23 01:37:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-243580435 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:37:20.072785 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:20.074883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:20.076170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d6d461fe-687e-4810-81f0-1aad05b49210 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.270444 Sep 23 01:37:20.076919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 420/834] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:19 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:21.111798 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:21.112423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:21.122981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:21.123487 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:21.123960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:21.124831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:21.125298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:21.126477 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:21.276394 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:21.290761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:21.294426 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:21.296731 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fe690dd3-2c74-4257-b834-6d72964ee77a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.190728 Sep 23 01:37:21.297738 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 415/835] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:21 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:22.339721 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:22.340870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:22.357982 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:22.360433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:22.361211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:22.363378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:22.364333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:22.365026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:22.561023 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:22.573640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:22.577293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:22.580024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ffda906b-5071-4a96-876d-97cb0911a008 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1732 microversion: 2.20 time: 0.246754 Sep 23 01:37:22.589405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 421/836] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:22 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:23.628381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:23.629220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:23.638735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:23.643242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:23.643242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:23.643242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:23.643242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:23.647300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:23.845175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:23.856853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:23.858349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:23.862259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9ef0b222-c2cd-42ca-90a2-1294ba7e014a tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1719 microversion: 2.20 time: 0.237163 Sep 23 01:37:23.862259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 416/837] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:23 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:23.959875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:23.960742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:23.972022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:23.973639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:23.974902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:23.975944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:23.976749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:23.977787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:23.999810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa HTTP/1.1 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:37:24.001739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.004262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '4e1e50a2-07b1-4707-867a-4959d35ba7fa'} Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:24.005121 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.006647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.008458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:24.008458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-70f0525b-16f5-4e1f-9755-d57b40c9f9a9 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 404 len: 111 microversion: 2.1 time: 0.049615 Sep 23 01:37:24.008458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 422/838] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:37:23 2022] DELETE /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:37:24.013605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:24.014221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 4e1e50a2-07b1-4707-867a-4959d35ba7fa] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:24.021643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:24.022287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:24.023010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:24.024209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:24.024977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:24.025706 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:24.048861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa HTTP/1.1 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:24.050785 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.056024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '4e1e50a2-07b1-4707-867a-4959d35ba7fa'} Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:24.058217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. Sep 23 01:37:24.060296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:24.062588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 4e1e50a2-07b1-4707-867a-4959d35ba7fa could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:24.062588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8bab432f-2884-42cb-aa7b-65f33f426ec7 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa" status: 404 len: 111 microversion: 2.1 time: 0.043564 Sep 23 01:37:24.062588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 417/839] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:24 2022] GET /compute/v2.1/servers/4e1e50a2-07b1-4707-867a-4959d35ba7fa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:37:25.469550 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:25.470370 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:25.480424 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:25.481063 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:25.481565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:25.482373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:25.483027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:25.483272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:25.498516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 HTTP/1.1 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:37:25.500713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.506355 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '09ce20b4-a04e-4dc8-b694-50be8ee53310'} Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:25.508282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.511181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.513414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:25.513414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6a14ad08-b954-4e9a-804d-bfd021b4e9be tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 404 len: 111 microversion: 2.1 time: 0.037891 Sep 23 01:37:25.513414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 423/840] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:37:25 2022] DELETE /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:37:25.517647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:25.518797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] [instance: 09ce20b4-a04e-4dc8-b694-50be8ee53310] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:25.529287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:25.529805 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:25.530243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:25.530961 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:25.531413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:25.531875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:25.546580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] HTTP exception thrown: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Request method failure captured: Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 HTTP/1.1 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwXqPd_ghza9rpwLACkhvoKYi42UNtxm-oc0-8LgwdyJWS7JX7jChwOcnu9NHrUsYZSpLZ9cnApuizg5YpOQaMBpZmj-tMO_lV6Fq7sXmwr24pWC9H_KNilIL_15W7esQNiHMiIzzb0SY4XV1EkV9Cb28NDkoqi6r3LDDIR-h-iSjI Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:25.548277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/92e9b7f9904f437f91148da9fc521326"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_92e9b7f9904f437f91148da9fc521326", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 92e9b7f9904f437f91148da9fc521326 Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeTestJSON-665610977 Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 1633ea35eda34ffe884140eaab1ae909 Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeTestJSON-665610977-project Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.550456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '09ce20b4-a04e-4dc8-b694-50be8ee53310'} Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:25.551901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. Sep 23 01:37:25.553726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:25.555803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] Returning 404 to user: Instance 09ce20b4-a04e-4dc8-b694-50be8ee53310 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:25.555803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-af17455e-fe70-44ab-81b4-cbdd505ea8f4 tempest-AttachVolumeTestJSON-665610977 tempest-AttachVolumeTestJSON-665610977-project] 10.222.0.64 "GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310" status: 404 len: 111 microversion: 2.1 time: 0.040484 Sep 23 01:37:25.555803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 418/841] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:25 2022] GET /compute/v2.1/servers/09ce20b4-a04e-4dc8-b694-50be8ee53310 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:37:33.162316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b9b9ba18-5cd7-4c5d-a220-ce5f5d983660 tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Action: 'create', calling method: .version_select at 0x7f7678f56790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-595794869", "metadata": {"Type": "work"}}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b9b9ba18-5cd7-4c5d-a220-ce5f5d983660 tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 121 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:37:33.180640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-595794869", "metadata": {"Type": "work"}}} Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:37:33.184123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-595794869', 'metadata': {'Type': 'work'}}}} Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise error Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi '#$%' Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.185849 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 01:37:33.202004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 01:37:33.203870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 23 01:37:33.203870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.203870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b9b9ba18-5cd7-4c5d-a220-ce5f5d983660 tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.203870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b9b9ba18-5cd7-4c5d-a220-ce5f5d983660 tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.165168 Sep 23 01:37:33.203870 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 424/842] 10.222.0.64 () {60 vars in 1156 bytes} [Fri Sep 23 01:37:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:37:33.204545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-208dee61-46b6-4d9f-8686-5d53126a25ba tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Action: 'create', calling method: .version_select at 0x7f7678fdc5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-103882216", "metadata": {"Type": "work"}}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-208dee61-46b6-4d9f-8686-5d53126a25ba tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 119 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:33.205025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-103882216", "metadata": {"Type": "work"}}} Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: Sep 23 01:37:33.206869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-103882216', 'metadata': {'Type': 'work'}}}} Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise error Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi '0' Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.208014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 01:37:33.209415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 01:37:33.210519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 23 01:37:33.210519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.210519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-208dee61-46b6-4d9f-8686-5d53126a25ba tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.210519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-208dee61-46b6-4d9f-8686-5d53126a25ba tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014811 Sep 23 01:37:33.210519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 419/843] 10.222.0.64 () {60 vars in 1156 bytes} [Fri Sep 23 01:37:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:37:33.220068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-de01f7ff-388a-4e3d-b158-e41a1c41e12b tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Action: 'create', calling method: .version_select at 0x7f7678f4b3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1437591207", "metadata": {"Type": "work"}}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-de01f7ff-388a-4e3d-b158-e41a1c41e12b tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 119 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:37:33.226886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1437591207", "metadata": {"Type": "work"}}} Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:37:33.228873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1437591207', 'metadata': {'Type': 'work'}}}} Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise error Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi '' Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.229713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 23 01:37:33.231016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 23 01:37:33.233824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 23 01:37:33.233824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.233824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-de01f7ff-388a-4e3d-b158-e41a1c41e12b tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.233824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-de01f7ff-388a-4e3d-b158-e41a1c41e12b tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012146 Sep 23 01:37:33.233824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 425/844] 10.222.0.64 () {60 vars in 1156 bytes} [Fri Sep 23 01:37:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 01:37:33.237868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6aad11fb-39b1-4fb0-a141-c6ca8ab065ad tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Calling method '.version_select at 0x7f76790ce4c0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:33.273401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-6aad11fb-39b1-4fb0-a141-c6ca8ab065ad tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] HTTP exception thrown: Volume tempest-invalid-96265922 could not be found. Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6aad11fb-39b1-4fb0-a141-c6ca8ab065ad tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-96265922 HTTP/1.1 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:33.279175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Volume tempest-invalid-96265922 could not be found. Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'tempest-invalid-96265922'} Sep 23 01:37:33.283903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-96265922 could not be found. (HTTP 404) (Request-ID: req-fb466fa2-5f87-4c9f-acbf-4f52934899f8) Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.285854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:37:33.288292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-96265922 could not be found. Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:33.290838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-96265922 could not be found. Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-96265922 could not be found. Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6aad11fb-39b1-4fb0-a141-c6ca8ab065ad tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 404 to user: Volume tempest-invalid-96265922 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6aad11fb-39b1-4fb0-a141-c6ca8ab065ad tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-96265922" status: 404 len: 97 microversion: 2.1 time: 0.048356 Sep 23 01:37:33.293392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 420/845] 10.222.0.64 () {58 vars in 1212 bytes} [Fri Sep 23 01:37:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-96265922 => generated 97 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 23 01:37:33.297504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a6151dff-fcd2-4564-8efd-f1b9e6efa937 tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006930 Sep 23 01:37:33.298506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 426/846] 10.222.0.64 () {58 vars in 1140 bytes} [Fri Sep 23 01:37:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 01:37:33.315915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-15e29f68-0a98-4492-bdbb-ac360fb79eda tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007643 Sep 23 01:37:33.316526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 421/847] 10.222.0.64 () {58 vars in 1137 bytes} [Fri Sep 23 01:37:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 23 01:37:33.329610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d448a3cd-3534-4cbd-b373-dee833ed47ae tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Calling method '.version_select at 0x7f76790533a0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:33.366898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-d448a3cd-3534-4cbd-b373-dee833ed47ae tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] HTTP exception thrown: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d448a3cd-3534-4cbd-b373-dee833ed47ae tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/os-volumes/64acceaf-1d3b-4a70-b0f4-3f85eb908b44 HTTP/1.1 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:37:33.369474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '64acceaf-1d3b-4a70-b0f4-3f85eb908b44'} Sep 23 01:37:33.371759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. (HTTP 404) (Request-ID: req-cecbcf25-469a-4528-899c-0791c2156502) Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.372626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 23 01:37:33.373877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 23 01:37:33.375146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d448a3cd-3534-4cbd-b373-dee833ed47ae tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 404 to user: Volume 64acceaf-1d3b-4a70-b0f4-3f85eb908b44 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d448a3cd-3534-4cbd-b373-dee833ed47ae tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/64acceaf-1d3b-4a70-b0f4-3f85eb908b44" status: 404 len: 109 microversion: 2.1 time: 0.048650 Sep 23 01:37:33.377364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 427/848] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:37:33 2022] DELETE /compute/v2.1/os-volumes/64acceaf-1d3b-4a70-b0f4-3f85eb908b44 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:37:33.382130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e5c93c92-80cd-4b18-9ef1-fbf74dd28b8d tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Calling method '.version_select at 0x7f7678fdc3a0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:33.415141 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-e5c93c92-80cd-4b18-9ef1-fbf74dd28b8d tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] HTTP exception thrown: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e5c93c92-80cd-4b18-9ef1-fbf74dd28b8d tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Request method failure captured: Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/os-volumes/9541482c-c688-4c45-bef7-650ac3fc3b2b HTTP/1.1 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ3cDkzhMFnJ6SDxZ03dBy-U2nkh0g9uQjSof6NZBcViMBV01LFiNOmNBf-IHbcDMUOrb73SV5ZWXNFD3xorDzHE7_VzouHSDY2hUsmCbwtqPjjwH-b4lxAJ8KuIJQy2sDCMLorW0IfCOX03g-HCF0oZI0MQimIaSzXHBqx5jWYZ0lE Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:37:33.417232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/b80d83d2a18d4830a9a9ed65b80b8f08"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_b80d83d2a18d4830a9a9ed65b80b8f08", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: b80d83d2a18d4830a9a9ed65b80b8f08 Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-VolumesNegativeTest-1351299805 Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 2645177d72c64f70a735d04a5c5529fc Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-VolumesNegativeTest-1351299805-project Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '9541482c-c688-4c45-bef7-650ac3fc3b2b'} Sep 23 01:37:33.428288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. (HTTP 404) (Request-ID: req-838ab4dc-c489-4ce7-90c6-e642a1cbc992) Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.429526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:37:33.431902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 01:37:33.433203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e5c93c92-80cd-4b18-9ef1-fbf74dd28b8d tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] Returning 404 to user: Volume 9541482c-c688-4c45-bef7-650ac3fc3b2b could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e5c93c92-80cd-4b18-9ef1-fbf74dd28b8d tempest-VolumesNegativeTest-1351299805 tempest-VolumesNegativeTest-1351299805-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/9541482c-c688-4c45-bef7-650ac3fc3b2b" status: 404 len: 109 microversion: 2.1 time: 0.040931 Sep 23 01:37:33.434357 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 422/849] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:37:33 2022] GET /compute/v2.1/os-volumes/9541482c-c688-4c45-bef7-650ac3fc3b2b => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:37:36.688446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:36.690938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=49 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:36.696329 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:36.697474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:36.704491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:36.705269 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:36.705904 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:36.706665 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:36.707337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:36.707943 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:36.741095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lazy-loading 'flavor' on Instance uuid 35c50f9b-7a91-48fb-9390-2149364acd41 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:37:37.133554 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-17ad4732-b87f-470c-a6fa-d30fc6320f40 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "POST /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41/action" status: 202 len: 0 microversion: 2.1 time: 0.446149 Sep 23 01:37:37.140701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 428/850] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:37:36 2022] POST /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41/action => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:37:37.146489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:37.147313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:37.152795 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:37.157405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=34 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:37:37.160842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:37.161446 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:37.162060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:37.164364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:37.165257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:37.167228 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:37.391209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:37.412322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-02dab9cf-6046-44b0-b22e-0e3e5b07c7ee tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.269540 Sep 23 01:37:37.413377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 423/851] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:37 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:38.445175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:38.446591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:38.460556 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:38.461087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:38.461613 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:38.462680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:38.463462 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:38.464335 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:38.686069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:38.700845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-54d8f467-9652-439c-a531-b9f6270c617d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.263150 Sep 23 01:37:38.701655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 429/852] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:38 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:39.725506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:39.726549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:39.736712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:39.737448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:39.738133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:39.739083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:39.739576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:39.740200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:39.919008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:39.927434 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ee0a014a-d9e7-43ec-a324-1560a4a659ff tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.206178 Sep 23 01:37:39.928042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 424/853] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:39 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:40.952542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:40.953409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:40.967304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:40.967861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:40.968299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:40.969238 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:40.969855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:40.970298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:41.187264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:41.198161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cd4f46a1-7424-4d8e-8e03-ac87de04f17d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.249575 Sep 23 01:37:41.199003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 430/854] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:40 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:42.239813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:42.240927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:42.258139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:42.259669 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:42.260199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:42.261932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:42.262326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:42.263251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:42.441701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:42.453914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5ef6d9fa-a028-41b1-9c78-80906c270464 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.218476 Sep 23 01:37:42.459533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 425/855] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:42 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:43.484172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:43.484806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:43.491916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:43.492432 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:43.492882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:43.493632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:43.494107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:43.494569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:43.689808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:43.698953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9741a2b3-72f0-407c-a323-1889bcbee493 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.219307 Sep 23 01:37:43.699900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 431/856] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:43 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:44.724476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:44.725060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:44.733482 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:44.734084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:44.734572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:44.735450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:44.736008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:44.736507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:44.888571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:44.897648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fb1b0fea-6c2a-47b4-80ac-b0130e398225 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.177250 Sep 23 01:37:44.898313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 426/857] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:44 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:45.924847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:45.925456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:45.932568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:45.933077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:45.933522 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:45.934230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:45.934690 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:45.935114 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:46.125999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:46.142210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f0fdad91-4fe3-46b3-8db9-8b073ca6907d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.221699 Sep 23 01:37:46.143579 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 432/858] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:45 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:47.173106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:47.173887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:47.188129 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:47.188633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:47.189072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:47.189913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:47.192772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:47.193212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:47.676178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:47.686242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d869f26b-e906-46ce-a519-ce7dc3d62e5b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.521580 Sep 23 01:37:47.686893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 427/859] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:47 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:48.715867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:48.716453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:48.723699 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:48.724250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:48.724752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:48.725502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:48.726241 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:48.726819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:48.887733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:48.896751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8417c6cf-5841-4311-b0f6-cde83c3594d1 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.186261 Sep 23 01:37:48.897452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 433/860] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:48 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:49.921362 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:49.922025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:49.930305 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:49.930816 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:49.931255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:49.932010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:49.932482 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:49.932939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:50.135727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:50.150018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-397f2e47-398a-4ae5-b550-653c4c81d17a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.232535 Sep 23 01:37:50.151077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 428/861] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:49 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:51.194158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:51.196285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:51.206026 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:51.206530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:51.206969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:51.207752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:51.208405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:51.208983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:51.437044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:51.448464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-266207b0-d6ef-4336-b7d5-fde2f726997c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.259749 Sep 23 01:37:51.449088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 434/862] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:51 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:52.496005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:52.497051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:52.506295 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:52.508291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:52.508780 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:52.510226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:52.510550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:52.510974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:52.746871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:52.764261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4c033d60-9a46-4a92-a9f9-268a78d7939c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.274222 Sep 23 01:37:52.765269 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 429/863] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:52 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:53.793085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:53.793883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:53.805562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:53.807436 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:53.815061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:53.816715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:53.817800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:53.818657 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:54.031884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:54.042376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1e2a3288-100e-419b-b0c7-46aa2eb6b3a0 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.256884 Sep 23 01:37:54.043606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 435/864] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:53 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:55.070342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:55.071618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:55.079576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:55.080497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:55.081095 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:55.082101 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:55.082556 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:55.082977 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:55.259342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:55.265801 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-64751885-2285-488e-a287-551ac6ceb7ba tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.199435 Sep 23 01:37:55.266654 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 430/865] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:55 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:56.294571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:56.295539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:56.306603 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:56.307210 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:56.307783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:56.309025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:56.309621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:56.310055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:56.497097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:56.506735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-136fde18-2cc5-4b61-8ca5-7f9ef3a5c2eb tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.219434 Sep 23 01:37:56.507333 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 436/866] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:56 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:57.493919 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:57.500923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:57.503598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.504125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.504598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.505393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.505941 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.506381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.532773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:57.533495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:57.542161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.542669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.543323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.544204 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.544733 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.545231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.549769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4e3be073-3509-461f-a4fc-601c34410a18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059941 Sep 23 01:37:57.550965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 431/867] 10.222.0.64 () {60 vars in 1343 bytes} [Fri Sep 23 01:37:57 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:57.636848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:57.636848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:57.639744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.640290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.640737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.641432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.642068 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.642626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.687711 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:37:57.734983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:57.746231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7792e2c5-6751-4e2a-a33e-e55c21b2533b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1566 microversion: 2.1 time: 0.218086 Sep 23 01:37:57.760397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 437/868] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:57 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1566 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:37:57.772510 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:57.773074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:57.780285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.780760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.781374 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.782091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:57.782544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:57.782967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:57.830481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121763) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 23 01:37:58.139907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-41420729-488e-4c91-8ee0-b0817a1cf426 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 204 len: 0 microversion: 2.20 time: 0.511664 Sep 23 01:37:58.141766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 432/869] 10.222.0.64 () {60 vars in 1280 bytes} [Fri Sep 23 01:37:57 2022] DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 23 01:37:58.166567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:58.167391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:58.174637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:58.175140 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:58.175595 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:58.176463 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:58.176856 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:58.177283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:58.264200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f94d2e13-27be-44ed-8087-daa02da8ef76 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "POST /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41/action" status: 202 len: 0 microversion: 2.1 time: 0.495146 Sep 23 01:37:58.265669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 438/870] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:37:57 2022] POST /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:37:58.275734 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:58.276754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:58.284716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:58.285323 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:58.286242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:58.287071 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:58.287652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:58.288091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:58.426495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:58.445610 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:58.448956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:58.455184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a3c5414e-c7cf-4417-ac2b-8f2deb52dcc9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.289892 Sep 23 01:37:58.455184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 433/871] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:58 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 23 01:37:58.566999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:58.582718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-179435cf-d852-400f-8379-9ae91a31960d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1514 microversion: 2.1 time: 0.311457 Sep 23 01:37:58.584066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 439/872] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:58 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:37:59.497424 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:59.501664 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:59.516346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:59.517257 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:59.518060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:59.519382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:59.520299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:59.529899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:59.638467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:37:59.641571 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:37:59.667885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:59.668928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:59.669417 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:59.670441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:59.671230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:59.671865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:59.757058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:59.770984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:59.773603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:37:59.776935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f6c510b3-336c-49a0-898c-24eafd2c0094 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.286824 Sep 23 01:37:59.777423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 434/873] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:37:59 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:37:59.845149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "name": "network-vif-unplugged", "status": "completed", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:37:59.869761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:37:59.869761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:37:59.869761 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:37:59.879181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.compute.server_external_events [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] Unable to find a host for instance 35c50f9b-7a91-48fb-9390-2149364acd41. Dropping event network-vif-unplugged {{(pid=121762) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 23 01:37:59.880126 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-71a902fb-232b-4ac8-b92a-634550a2f1a7 req-53237099-e6c8-428f-a282-b90f523c05a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.054215 Sep 23 01:37:59.880798 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 435/874] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 23 01:38:00.093692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:00.113888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4a75cdd6-7362-4852-a8df-ef6827833dd5 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1514 microversion: 2.1 time: 0.493645 Sep 23 01:38:00.114679 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 440/875] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:37:59 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1514 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:00.822545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:00.823243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:00.833372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:00.834056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:00.834553 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:00.835886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:00.836008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:00.836346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:01.023502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:01.034536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:01.036264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:01.039897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-86dd9371-ea9b-425c-bace-fb546c518f31 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1725 microversion: 2.20 time: 0.224151 Sep 23 01:38:01.041043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 436/876] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:00 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:38:01.143634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:01.144445 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:01.151352 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:01.151998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:01.152662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:01.153564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:01.154154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:01.154659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:01.176938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:01.471263 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bce51dee-2d0e-4c4c-9517-63a261f63950", "name": "network-vif-deleted", "tag": "333f7a1f-cce8-4fcd-9a21-9176a214a076"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:01.474694 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:01.487155 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-636b44dd-cdf2-4271-90af-bb7291438100 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1514 microversion: 2.1 time: 0.347417 Sep 23 01:38:01.487527 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:01.487872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 441/877] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:01 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1514 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:01.488567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:01.489063 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:01.504129 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] Creating event network-vif-deleted:333f7a1f-cce8-4fcd-9a21-9176a214a076 for instance bce51dee-2d0e-4c4c-9517-63a261f63950 on hv-cinder-84914 Sep 23 01:38:01.510411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-4f5b0281-5d3b-461a-815c-a5d8b151d0c2 req-81c58a44-1652-407a-864c-ade9f5470b55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042895 Sep 23 01:38:01.511448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 437/878] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:38:02.068389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:02.069003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:02.075937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:02.076646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:02.076899 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:02.077621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:02.078097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:02.078521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:02.135853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:02.136745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:02.137539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:02.138389 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid bce51dee-2d0e-4c4c-9517-63a261f63950 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:38:02.193566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:02.204028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:02.205975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:02.207211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-86713b86-7a19-4a21-b38f-97a87136c7a9 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1372 microversion: 2.20 time: 0.143173 Sep 23 01:38:02.208129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 442/879] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:02 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1372 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:38:02.518609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:02.519380 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:02.528917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:02.529499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:02.530075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:02.530932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:02.531534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:02.532221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:02.738349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:02.752083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-80bac97c-f4e9-4127-aecd-5eafde42498d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1514 microversion: 2.1 time: 0.240735 Sep 23 01:38:02.752709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 438/880] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:02 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:03.234880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:03.235482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:03.242403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:03.243002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:03.243540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:03.244492 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:03.245072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:03.245532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:03.279430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:03.280262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:03.280388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:03.280853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid bce51dee-2d0e-4c4c-9517-63a261f63950 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:38:03.326850 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:03.452926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:03.454198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:03.456696 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-64cb50de-b21f-4b3b-9b5f-5a2f7eea0482 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1372 microversion: 2.20 time: 0.225338 Sep 23 01:38:03.457819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 443/881] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:03 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1372 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:38:03.777789 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:03.779037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:03.785935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:03.786439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:03.786857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:03.787645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:03.788054 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:03.788483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:03.793409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:03.943807 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:03.952854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0a8c1ba7-c06d-4095-b3b5-c76f5da75179 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1514 microversion: 2.1 time: 0.180009 Sep 23 01:38:03.953532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 439/882] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:03 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:04.483678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:04.484981 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:04.491015 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:04.491502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:04.492200 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:04.492872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:04.493233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:04.493652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:04.527897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:04.528312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:04.528743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:04.529293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid bce51dee-2d0e-4c4c-9517-63a261f63950 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:38:04.575693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:04.589243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:04.590779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:04.592034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-28f1147c-9bb8-4790-b002-405df4eeaca8 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1372 microversion: 2.20 time: 0.112234 Sep 23 01:38:04.592823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 444/883] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:04 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1372 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:38:04.984009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:04.984009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:04.988695 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:04.989214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:04.989899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:04.990603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:04.991056 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:04.991479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:05.140630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:05.148842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0cf7c53b-d764-422a-ad5d-246fc9627a75 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1516 microversion: 2.1 time: 0.173612 Sep 23 01:38:05.149465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 440/884] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:04 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1516 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:05.619195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:05.619835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:05.626634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:05.627115 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:05.627544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:05.628276 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:05.628723 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:05.629156 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:05.665469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:05.666492 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:05.667206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:05.667933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lazy-loading 'fault' on Instance uuid bce51dee-2d0e-4c4c-9517-63a261f63950 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:38:05.716836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:05.725926 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:05.727366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62f175cb5d1e4ac8a0ee95cf7718837b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc926b4dede94c3b92441b0c610771f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:05.729134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d74e6371-5030-4c05-9288-00be12143d37 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 200 len: 1372 microversion: 2.20 time: 0.114920 Sep 23 01:38:05.729700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 445/885] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:05 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 23 01:38:06.174332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:06.175003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:06.183201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:06.183743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:06.184246 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:06.185046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:06.185420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:06.185895 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:06.344493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:06.352851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6faa32e7-d5e2-45d0-9a6f-a4ba2ccc55d6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1516 microversion: 2.1 time: 0.182561 Sep 23 01:38:06.354046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 441/886] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:06 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:06.754430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:06.755041 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:06.762817 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:06.763313 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:06.763781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:06.764494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:06.764950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:06.765369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:06.942612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 HTTP/1.1 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:38:06.944468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:06.947481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'bce51dee-2d0e-4c4c-9517-63a261f63950'} Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:38:06.949105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:06.951794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:06.954118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:38:06.954118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-06973130-5ca3-4120-87ca-397ec4ca146e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 404 len: 111 microversion: 2.20 time: 0.195556 Sep 23 01:38:06.954118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 446/887] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:06 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:38:06.960369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-713a8b6d-78d5-4723-8bb0-fc577b69635e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '.version_select at 0x7f76792085e0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:07.050512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-713a8b6d-78d5-4723-8bb0-fc577b69635e tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489334857" status: 204 len: 0 microversion: 2.20 time: 0.096534 Sep 23 01:38:07.051282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 442/888] 10.222.0.64 () {60 vars in 1262 bytes} [Fri Sep 23 01:38:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1489334857 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 23 01:38:07.382889 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:07.383506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:07.389876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:07.390361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:07.390792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:07.391491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:07.391970 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:07.392391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:07.630235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:07.639306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cea136ef-a1e8-4374-81a8-0c527158b718 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1516 microversion: 2.1 time: 0.260341 Sep 23 01:38:07.639908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 447/889] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:07 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:08.665793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:08.667026 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:08.675109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:08.675697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:08.676310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:08.677174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:08.677703 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:08.684639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:08.840413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:08.850252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-95f629f9-c973-44bd-930c-a4d15c5d5714 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1516 microversion: 2.1 time: 0.189423 Sep 23 01:38:08.850837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 443/890] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:08 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1516 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:09.874339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:09.875119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:09.877642 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:09.882789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:09.883271 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:09.883743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:09.884521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:09.885005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:09.885465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:10.047928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:10.055996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f262fe3c-0929-40dc-bb85-5a18f1499578 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.185681 Sep 23 01:38:10.056625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 448/891] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:09 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:10.455983 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:10.457043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:10.460727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:10.468491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:10.469041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:10.469477 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:10.470185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:10.470645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:10.471071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:10.491220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 HTTP/1.1 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:38:10.493029 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.495447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'bce51dee-2d0e-4c4c-9517-63a261f63950'} Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:38:10.496562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.498283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.500665 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:38:10.500665 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d8ca4f79-84f1-4834-9957-4600d8afd594 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 404 len: 111 microversion: 2.20 time: 0.046858 Sep 23 01:38:10.500665 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 444/892] 10.222.0.64 () {60 vars in 1280 bytes} [Fri Sep 23 01:38:10 2022] DELETE /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:38:10.506353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:10.507057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: bce51dee-2d0e-4c4c-9517-63a261f63950] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:10.518652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:10.519487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:10.520270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:10.521518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:10.522338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:10.523090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:10.545171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 HTTP/1.1 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:38:10.547339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.549106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'bce51dee-2d0e-4c4c-9517-63a261f63950'} Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:38:10.549933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. Sep 23 01:38:10.552423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:38:10.555702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance bce51dee-2d0e-4c4c-9517-63a261f63950 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:38:10.555702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bd14fee0-d9fe-40d4-9204-d7ae8b1a0e18 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950" status: 404 len: 111 microversion: 2.20 time: 0.047655 Sep 23 01:38:10.555702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 449/893] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:10 2022] GET /compute/v2.1/servers/bce51dee-2d0e-4c4c-9517-63a261f63950 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:38:11.081741 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:11.082689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:11.094420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:11.094968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:11.095915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:11.097817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:11.099049 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:11.099984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:11.277393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:11.295525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2780bbf3-9c46-4d56-98a9-f8fc16735b5c tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.211947 Sep 23 01:38:11.295525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 445/894] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:11 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:12.319827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:12.321117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:12.331173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.331957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.332540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.333366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.334036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.334662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.352202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:12.352997 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:12.364935 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.382705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.382705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.382705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.382705 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.383696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.388894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d HTTP/1.1 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:38:12.390535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.392386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'dd3312b8-1d33-4b15-9ffd-270013a3b14d'} Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:38:12.393255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.394670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.396304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:38:12.396304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-027ced77-b722-4c16-9559-32c0e754aeea tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 404 len: 111 microversion: 2.20 time: 0.048509 Sep 23 01:38:12.396304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 446/895] 10.222.0.64 () {60 vars in 1280 bytes} [Fri Sep 23 01:38:12 2022] DELETE /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:38:12.402379 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:12.402998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] [instance: dd3312b8-1d33-4b15-9ffd-270013a3b14d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:12.414106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.417159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.417159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.417159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:12.417159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:12.417566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:12.433277 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] HTTP exception thrown: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Request method failure captured: Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d HTTP/1.1 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQwYOIs2V_NpaZGBxSXLGALMowpyKtXRSp3BpgLa0fKGupcUVp2jdPwBjzJJegoh1bZN7DS8mcpnk_jweJZT1eSHZZhJVxn-LygCu8pgcPJdd9JiQ9684JAYxZM1k27rTPvije-fB487gOs9F0l3vCOBbUVwjFC8JbW-5LMG9B48DG8 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Openstack-Nova-Api-Version: 2.20 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:38:12.434881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cc926b4dede94c3b92441b0c610771f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cc926b4dede94c3b92441b0c610771f6", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: cc926b4dede94c3b92441b0c610771f6 Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-85092964 Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 62f175cb5d1e4ac8a0ee95cf7718837b Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeShelveTestJSON-85092964-project Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.436631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'dd3312b8-1d33-4b15-9ffd-270013a3b14d'} Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:38:12.437503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. Sep 23 01:38:12.439102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:38:12.440439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] Returning 404 to user: Instance dd3312b8-1d33-4b15-9ffd-270013a3b14d could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:38:12.440439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c8ee67f5-7181-43f9-a665-e06ce63f2828 tempest-AttachVolumeShelveTestJSON-85092964 tempest-AttachVolumeShelveTestJSON-85092964-project] 10.222.0.64 "GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d" status: 404 len: 111 microversion: 2.20 time: 0.038705 Sep 23 01:38:12.440439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 447/896] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Sep 23 01:38:12 2022] GET /compute/v2.1/servers/dd3312b8-1d33-4b15-9ffd-270013a3b14d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:38:12.537610 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:12.547037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d164a170-3951-4508-935d-fce5c30c1f3d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.232662 Sep 23 01:38:12.547808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 450/897] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:12 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:13.574135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:13.575070 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:13.582899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:13.583433 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:13.584175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:13.585288 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:13.585863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:13.586409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:13.796637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:13.807975 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-974d5e6d-04df-4e8e-b538-02e978728ccc tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.240345 Sep 23 01:38:13.808822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 448/898] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:13 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:14.856651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:14.860487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:14.878446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:14.880965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:14.881942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:14.883979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:14.886309 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:14.889908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:15.104332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:15.135479 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ed20ffde-5470-47bd-8f20-d7ed803d9ff7 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.288282 Sep 23 01:38:15.139013 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 451/899] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:14 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:16.171829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:16.172991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:16.188992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:16.190172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:16.190971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:16.192486 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:16.193556 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:16.194528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:16.350208 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:16.358824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-aeb8cc51-80c9-45ad-a27a-7ec6b865e319 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.194535 Sep 23 01:38:16.359459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 449/900] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:16 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:17.386076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:17.386728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:17.399606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:17.399606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:17.399606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:17.399606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:17.400640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:17.400640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:17.562543 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:17.571347 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3bcb7b64-c453-47f6-a23b-169264f9e350 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.191111 Sep 23 01:38:17.571999 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 452/901] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:17 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:18.594758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:18.595349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:18.602319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:18.602809 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:18.603361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:18.604632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:18.604632 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:18.605111 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:18.749988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:18.758885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-021aef98-f4e7-4032-85ec-53de78e433e6 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.168052 Sep 23 01:38:18.760103 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 450/902] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:18 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:19.783584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:19.784217 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:19.792361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:19.792893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:19.793361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:19.794085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:19.794540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:19.794969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:19.935616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:19.943357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-282f41d5-d46b-447f-afbc-1c7a3b3ed821 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.163742 Sep 23 01:38:19.943945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 453/903] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:19 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:20.967215 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:20.968225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:20.971644 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:38:20.971880 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Fri Sep 23 01:38:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 (ip 10.222.0.64) !!! Sep 23 01:38:20.983472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:20.985912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:20.985912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:20.986528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:20.987195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:20.987700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:21.180549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:21.189282 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-84c36ef7-1992-48c4-b60e-4c92aa924ce4 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.226616 Sep 23 01:38:21.190377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 451/904] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:20 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:22.221423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:22.223935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:22.235298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:22.236002 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:22.236710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:22.237542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:22.238322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:22.239194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:22.381558 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:38:22.381762 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Fri Sep 23 01:38:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 (ip 10.222.0.64) !!! Sep 23 01:38:22.533901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:22.549566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9036a0c2-2662-4568-ae28-65eb43f49f7f tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.335702 Sep 23 01:38:22.551091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 454/905] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:22 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:23.576034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:23.578225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:23.586317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:23.586740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:23.588248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:23.589416 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:23.590076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:23.590691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:24.068210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:24.084890 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-05f7400d-c340-4ad1-99ca-c42581e5eade tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.513445 Sep 23 01:38:24.101841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 452/906] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:23 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:24.988384 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "name": "network-vif-plugged", "status": "completed", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:25.000958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:25.001705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:25.002266 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:25.016076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] Creating event network-vif-plugged:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:38:25.021914 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-35ec9e61-0346-48fe-963c-8a5a1006501b req-d8776b95-a46a-4639-8f9b-e3e522230439 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038249 Sep 23 01:38:25.022943 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 455/907] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:38:25.136398 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:25.137211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:25.144220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:25.144717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:25.145154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:25.145877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:25.146330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:25.146756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:25.370701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:25.383937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9cf4cbcd-8fce-401e-900b-d37199fb5df8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.252512 Sep 23 01:38:25.385265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 453/908] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:25 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:26.413756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:26.414560 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:26.427956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:26.427956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:26.427956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:26.427956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:26.428267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:26.428267 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:26.795857 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:26.804539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bde7fd8d-e893-4eba-9445-f613650d0b87 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1572 microversion: 2.1 time: 0.395201 Sep 23 01:38:26.805116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 456/909] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:26 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1572 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:27.160148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-655b5a27-040a-4d84-9006-51b89fd62aa6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: .version_select at 0x7f7678fdc1f0>, body: {"keypair": {"name": "tempest-keypair-224575336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbKj3un/L2hggMa7LdWVrpz8F6Djcl7hZ9PqEiHCJluAstmWj+SGO3ajLHvGZaw4npv2wMSqk6mQodyvvVG8qlSpmbfcT4v1G4nW/DGvdvmNTk2Pl6CYbqxpumK/GAy7g=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:27.179512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-655b5a27-040a-4d84-9006-51b89fd62aa6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:38:27.184171 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-655b5a27-040a-4d84-9006-51b89fd62aa6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:38:27.356872 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-655b5a27-040a-4d84-9006-51b89fd62aa6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.347629 Sep 23 01:38:27.366853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 454/910] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:38:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:38:27.834718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:27.838919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:27.842321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:27.843201 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:27.843337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:27.844044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:27.844569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:27.845007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:28.003249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:28.016777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f6367027-306e-44bf-8b8c-1dab1e4c2ab8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1559 microversion: 2.1 time: 0.191419 Sep 23 01:38:28.017359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 457/911] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:27 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1559 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:30.606434 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1593041712", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "970b65ab-4e22-445a-8ff5-01dfad2a0bf4"}], "security_groups": [{"name": "tempest-securitygroup--2139727587"}], "key_name": "tempest-keypair-224575336", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:30.727330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] validate_networks() for [('970b65ab-4e22-445a-8ff5-01dfad2a0bf4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:38:31.116385 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:38:31.116808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:38:31.117272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:38:31.117853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:38:31.118264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:38:31.128052 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:31.128730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:31.129137 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:31.129973 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:31.130563 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:31.131074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:31.156550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:38:31.161363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:38:31.174742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:38:31.177382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:38:31.384967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff8de7f5-13f0-4c99-b941-c733bfb08e46 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.782977 Sep 23 01:38:31.385621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 455/912] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:38:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:38:31.397471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ceb84f94-4b44-4910-9eb6-4fa14108529f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:31.398818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ceb84f94-4b44-4910-9eb6-4fa14108529f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:31.461540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ceb84f94-4b44-4910-9eb6-4fa14108529f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:31.469540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ceb84f94-4b44-4910-9eb6-4fa14108529f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1241 microversion: 2.1 time: 0.075781 Sep 23 01:38:31.475910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 458/913] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:31 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:32.497881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2790e631-f23d-4439-8522-79a5dcd14879 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:32.498963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2790e631-f23d-4439-8522-79a5dcd14879 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:32.570691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2790e631-f23d-4439-8522-79a5dcd14879 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:32.578959 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2790e631-f23d-4439-8522-79a5dcd14879 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1241 microversion: 2.1 time: 0.088263 Sep 23 01:38:32.579584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 456/914] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:32 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:33.607079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:33.608025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:33.615792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:33.616348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:33.616837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:33.617517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:33.617974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:33.618399 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:33.621864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=95 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:33.695740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:33.714821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7d3680b2-0e29-4084-9cb9-0b05c84bde99 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1237 microversion: 2.1 time: 0.111578 Sep 23 01:38:33.716415 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 459/915] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:33 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1237 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:34.745879 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:34.775448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:34.775448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:34.775448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:34.775448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:34.776022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:34.776022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:34.776022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:34.829600 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:34.844363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f929e4e9-332e-4325-8e7d-b72c012bf3c0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1293 microversion: 2.1 time: 0.103062 Sep 23 01:38:34.845442 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 457/916] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:34 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1293 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:35.883509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:35.885651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:35.897845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:35.898659 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:35.899366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:35.900573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:35.901313 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:35.902009 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:36.020964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:36.030151 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-51a15a92-0772-4fa4-bc5d-0df86412209b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1299 microversion: 2.1 time: 0.153877 Sep 23 01:38:36.030920 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 460/917] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:35 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:37.059434 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:37.060543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:37.072994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:37.073937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:37.074729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:37.075735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:37.076592 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:37.077369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:37.086400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=79 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:37.271991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:37.287069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-be881f7e-f15d-4ba2-91e5-86b5059934fc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.230768 Sep 23 01:38:37.287069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 458/918] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:37 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:38:37.873934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9aa9456-2386-4774-acb6-bce201e6d94d", "tag": "71b6fced-1490-49f1-9d45-9f897ad02832"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:37.885863 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:37.886347 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:37.894552 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:37.900169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] Creating event network-changed:71b6fced-1490-49f1-9d45-9f897ad02832 for instance b9aa9456-2386-4774-acb6-bce201e6d94d on hv-cinder-84914 Sep 23 01:38:37.905453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-a7ec94d7-2e33-46a1-9dee-8fe5e573d199 req-26117946-22f6-44ef-ac59-5b33a2047545 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Sep 23 01:38:37.906074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 461/919] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:38:38.311944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:38.312920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:38.320871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:38.321883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:38.322317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:38.323176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:38.323515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:38.324047 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:38.495212 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:38.510096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-05886f37-b7e2-418c-8ba8-f4616cbb59f6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.202475 Sep 23 01:38:38.523805 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 459/920] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:38 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:39.535530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:39.536343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:39.544375 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:39.545110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:39.545554 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:39.546540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:39.547648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:39.548321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:39.705599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:39.714702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-154aa01d-f5aa-4b95-a2f3-ae4ad9752698 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.183840 Sep 23 01:38:39.715285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 462/921] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:39 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:40.738258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:40.738875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:40.746706 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:40.747192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:40.747680 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:40.748708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:40.749522 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:40.750112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:40.939573 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:40.948437 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a500ec79-ca01-4d9b-be1a-363eab91acd4 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.214089 Sep 23 01:38:40.949106 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 460/922] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:40 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:42.005395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:42.005395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:42.005395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:42.005395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=32 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:42.005395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:42.006414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:42.006414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:42.006414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:42.006414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:42.006862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:42.137568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:42.145567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7cd69a2c-46a0-4398-9819-48da72b42570 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.175471 Sep 23 01:38:42.146140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 463/923] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:41 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:43.174759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:43.178903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:43.179252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:43.181814 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=12 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:43.190377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:43.191333 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:43.192193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:43.193559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:43.194393 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:43.195180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:43.434773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:43.445890 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-791dfead-6c48-4e59-b5f4-db946f9b26a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.277282 Sep 23 01:38:43.449832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 461/924] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:43 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:44.474638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:44.475427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:44.483213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:44.483669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:44.484168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:44.484862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:44.485354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:44.485776 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:44.625324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:44.633557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c2fd228e-0159-4c97-99c4-2d26b11e4971 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.162865 Sep 23 01:38:44.634694 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 464/925] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:44 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:44.788245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9aa9456-2386-4774-acb6-bce201e6d94d", "name": "network-vif-plugged", "status": "completed", "tag": "71b6fced-1490-49f1-9d45-9f897ad02832"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:44.795065 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:38:44.800931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:44.807766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:44.807766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:44.814088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] Creating event network-vif-plugged:71b6fced-1490-49f1-9d45-9f897ad02832 for instance b9aa9456-2386-4774-acb6-bce201e6d94d on hv-cinder-84914 Sep 23 01:38:44.819631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-1baf188a-6dfd-4800-b5f3-bb4cc09f1be4 req-2fb4f40b-40ca-4caa-992e-d7c563e1d646 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036010 Sep 23 01:38:44.820231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 462/926] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:38:45.658137 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:45.658767 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:45.666528 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:45.667020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:45.667454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:45.668301 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:45.668755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:45.669182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:45.813396 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:45.821879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6bc4fc84-468e-4848-ad6c-03535d5caf09 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1367 microversion: 2.1 time: 0.167362 Sep 23 01:38:45.822521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 465/927] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:45 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:46.846717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:46.847743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:46.855089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:46.855606 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:46.856080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:46.856743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:46.857200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:46.857626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:47.005014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:38:47.013722 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-757cbd7b-282f-4589-b376-b956d65bdf98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1555 microversion: 2.1 time: 0.171778 Sep 23 01:38:47.014296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 463/928] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:38:46 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:38:47.036521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:38:47.037118 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:38:47.044312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:47.044746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:47.045337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:47.046081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:47.046595 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:47.047024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:47.132372 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-24c6acc0-0e3b-4f95-965f-169b71fe73a5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099807 Sep 23 01:38:47.133044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 466/929] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:38:47 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:38:48.226474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9aa9456-2386-4774-acb6-bce201e6d94d", "tag": "71b6fced-1490-49f1-9d45-9f897ad02832"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:38:48.238000 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:38:48.238482 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:38:48.238923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:38:48.252708 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] Creating event network-changed:71b6fced-1490-49f1-9d45-9f897ad02832 for instance b9aa9456-2386-4774-acb6-bce201e6d94d on hv-cinder-84914 Sep 23 01:38:48.258437 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-73d6eae8-ef57-4c15-b379-28856e1f3262 req-7f7d0d09-94f0-41c6-9e28-8ac39947b2aa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036274 Sep 23 01:38:48.259650 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 464/930] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:01.449380 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=7 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:01.450632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=41 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:01.781544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f31861c4-8abb-4107-8296-d25fd41c0375 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Action: 'create', calling method: .version_select at 0x7f7678f2b5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-277631498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwSPso5zKRal+wzy4htCfbpnsm3VTtTq1jfQ0bwYUzQBisDoFiM6ouoXbK1sAYM4YSI7t64a6FAe1Yh45vOW/+Ag2yK/uiy0ogdDOCh+IrEdfcCOX4JKo5Vsxn1NJMzlw=="}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:01.812501 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-f31861c4-8abb-4107-8296-d25fd41c0375 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:39:01.821193 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-f31861c4-8abb-4107-8296-d25fd41c0375 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for user ad7c407cfe924b7a8652f8387c7f77b4 and project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:39:01.976307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f31861c4-8abb-4107-8296-d25fd41c0375 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.528305 Sep 23 01:39:01.977780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 467/931] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:39:01 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:23.065518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=5 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:23.066437 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=33 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:23.071030 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-730529447", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-277631498", "security_groups": [{"name": "tempest-secgroup-smoke-309655662"}], "block_device_mapping_v2": [{"uuid": "a1c54760-d294-4862-9a29-b4e542fba139", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1919f-1f3e-419a-91a3-220386faadcd"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:23.206038 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] validate_networks() for [('7fe1919f-1f3e-419a-91a3-220386faadcd', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:39:23.876374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:39:23.876850 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:39:23.877287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:39:23.877694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:39:23.878100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:39:23.887247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:23.887766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:23.888194 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:23.888914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:23.889363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:23.889847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:23.907904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:39:23.912063 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for user ad7c407cfe924b7a8652f8387c7f77b4 and project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:39:23.976542 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:39:23.979704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1c54760-d294-4862-9a29-b4e542fba139',volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:39:24.733675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=4 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:24.734439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:24.738941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:24.739471 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:24.747312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:24.747829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:24.748417 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:24.749133 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:24.749589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:24.750009 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:24.775481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f3683f3f-1565-4dc8-b88d-939329fc7bfd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/ips" status: 200 len: 148 microversion: 2.1 time: 0.043189 Sep 23 01:39:24.776147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 468/932] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:39:24 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:39:24.799914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3427121c-80f8-400f-b2dc-9b3aa578668f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.735573 Sep 23 01:39:24.801605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 465/933] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:39:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:39:24.814004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-36a28419-e121-498a-9a1a-bd01abae9926 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:24.814953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-36a28419-e121-498a-9a1a-bd01abae9926 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:24.891476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-36a28419-e121-498a-9a1a-bd01abae9926 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:24.899111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-36a28419-e121-498a-9a1a-bd01abae9926 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1093 microversion: 2.1 time: 0.089360 Sep 23 01:39:24.899752 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 469/934] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:24 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:25.930244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a1c07f52-d64a-4969-8180-8a183370eb72 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:25.931523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a1c07f52-d64a-4969-8180-8a183370eb72 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:25.988255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a1c07f52-d64a-4969-8180-8a183370eb72 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:25.996169 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a1c07f52-d64a-4969-8180-8a183370eb72 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1093 microversion: 2.1 time: 0.070361 Sep 23 01:39:25.996749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 466/935] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:25 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:27.015908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d140d2f2-16ff-4f21-bf3c-513e8b8592ac"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:27.018470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:27.019662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:27.020628 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:27.026559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:27.027332 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:27.028952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:27.029220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:27.029838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:27.030048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:27.030550 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:27.030736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:27.031085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:27.031772 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:27.032388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:27.033103 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:27.127805 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:27.137792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b33d7b64-e9e6-45a0-8b55-ef5449ca3588 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1143 microversion: 2.1 time: 0.122874 Sep 23 01:39:27.142473 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 467/936] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:27 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1143 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:28.139179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bd38c78e-7364-465d-94cd-a293b205e2a1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.127473 Sep 23 01:39:28.140246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 470/937] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:39:27 2022] POST /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:28.165407 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:28.166133 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:28.174060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:28.174060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:28.174506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:28.175253 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:28.176405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:28.177157 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:28.296567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:28.310472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-100dccb6-6de4-4691-9659-4ba473a05dde tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1191 microversion: 2.1 time: 0.149000 Sep 23 01:39:28.311502 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 468/938] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:28 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1191 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:29.356773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:29.357688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:29.368922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:29.369711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:29.370430 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:29.371648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:29.372393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:29.376023 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:29.454844 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:29.470564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0f1223fe-3901-4a27-bccd-4f0b091b89f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1209 microversion: 2.1 time: 0.119123 Sep 23 01:39:29.483582 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 471/939] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:29 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1209 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:30.499144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:30.499885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:30.507229 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:30.507766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:30.508353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:30.509456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:30.510544 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:30.510978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:30.684070 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:30.692458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ff2120eb-527f-46cf-87cd-3bbc363e9a87 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.197243 Sep 23 01:39:30.693409 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 469/940] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:30 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:30.785295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84ea01c-1bd5-4928-832e-e939c785fcb2", "tag": "76aa0f1b-1f50-4ed6-9407-e64aa3b79462"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:30.800367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:30.801187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:30.801933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:30.823927 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] Creating event network-changed:76aa0f1b-1f50-4ed6-9407-e64aa3b79462 for instance d84ea01c-1bd5-4928-832e-e939c785fcb2 on hv-cinder-84914 Sep 23 01:39:30.832248 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-d2cd3375-d5a9-4881-b9b1-032a4af41e2b req-80572e48-d7f4-4231-abc2-f2ab5b343042 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050111 Sep 23 01:39:30.833351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 472/941] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:31.717055 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:31.717796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:31.725051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:31.725536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:31.725968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:31.726678 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:31.727869 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:31.728306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:31.897043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:31.910310 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7d122b11-bdb5-4048-9f98-6d215d617303 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.197181 Sep 23 01:39:31.911456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 470/942] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:31 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:32.939162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:32.940016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:32.947418 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:32.947967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:32.948446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:32.949197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:32.949692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:32.950149 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:33.106958 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:33.112601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6c170af0-1363-4f28-90f7-42c7879c71ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.178973 Sep 23 01:39:33.113174 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 473/943] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:32 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:34.136572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:34.137184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:34.139846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:34.145149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:34.145638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:34.146076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:34.146788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:34.147300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:34.147813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:34.295509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:34.304338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dda24655-367f-4559-9693-f1a100db6963 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.172113 Sep 23 01:39:34.304938 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 471/944] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:34 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:35.327774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:35.328380 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:35.331123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:35.336297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:35.336815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:35.337737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:35.338497 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:35.338946 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:35.339367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:35.489308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:35.497775 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-791f6d59-1509-4aa3-804d-f640b24de0b3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.173937 Sep 23 01:39:35.498377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 474/945] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:35 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:35.860130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2d56a6e-0f78-4fd1-b02f-30e2f28932d1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: .version_select at 0x7f7679261790>, body: {"keypair": {"name": "tempest-keypair-1249438192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqPrrcHVmuAhSSdTmKGJf+g2iiCttDWBcec/Hw6TkUGANmh1bt6TEL6+zHrhk5TaJ4D17rTEiIEtcPRH4296ngxaS+ixOH5OZlYi0BAboZIVvi2MwzNMCCxwad4thQaDw=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:35.878174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-e2d56a6e-0f78-4fd1-b02f-30e2f28932d1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:39:35.882574 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-e2d56a6e-0f78-4fd1-b02f-30e2f28932d1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:39:36.003051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e2d56a6e-0f78-4fd1-b02f-30e2f28932d1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146947 Sep 23 01:39:36.003607 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 472/946] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:39:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:36.521054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:36.521793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:36.530176 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:36.530612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:36.531048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:36.531765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:36.532245 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:36.532663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:36.678570 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:36.686549 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-753831d0-1b61-4e11-a856-62ddb43d1b66 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1276 microversion: 2.1 time: 0.169622 Sep 23 01:39:36.687483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 475/947] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:36 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:37.708965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:37.736005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:37.736005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:37.736005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:37.736005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:37.737824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:37.737824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:37.737824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:38.057519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:38.057519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ce483b1e-6f95-4b5c-8f6b-990fe4e2c06d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.251892 Sep 23 01:39:38.057519 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 473/948] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:37 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:38.984901 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:38.985845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:38.993307 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:38.993800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:38.994242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:38.994956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:38.995416 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:38.995880 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:39.153621 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:39.162835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c63c1410-a87d-4d29-b54e-09396637be20 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.182020 Sep 23 01:39:39.163457 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 476/949] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:38 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:39.363891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-672971019", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "970b65ab-4e22-445a-8ff5-01dfad2a0bf4"}], "security_groups": [{"name": "tempest-securitygroup--1759784752"}], "key_name": "tempest-keypair-1249438192", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:39.478855 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] validate_networks() for [('970b65ab-4e22-445a-8ff5-01dfad2a0bf4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:39:39.903002 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:39:39.903420 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:39:39.903925 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:39:39.904334 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:39:39.904775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:39:39.914136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:39.914614 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:39.915545 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:39.916321 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:39.916770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:39.917255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:39.935781 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:39:39.940032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:39:39.952751 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:39:39.954954 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:39:40.094845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-01fd9a82-d2f5-4dfc-8fd0-86a2a0ea4b05 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.735185 Sep 23 01:39:40.095852 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 474/950] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:39:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:39:40.108612 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-82f783af-06f6-4e30-85c3-9bbad2013780 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:40.109234 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-82f783af-06f6-4e30-85c3-9bbad2013780 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:40.163331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-82f783af-06f6-4e30-85c3-9bbad2013780 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:40.172315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-82f783af-06f6-4e30-85c3-9bbad2013780 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1241 microversion: 2.1 time: 0.067453 Sep 23 01:39:40.172910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 477/951] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:40 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:40.186584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:40.187213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:40.194356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:40.194841 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:40.195287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:40.196005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:40.196518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:40.196943 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:40.355667 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:40.363913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-07575c1d-0606-4836-8588-1c05998d6e16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.181104 Sep 23 01:39:40.364662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 475/952] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:40 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:41.198243 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:41.198826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:41.206353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:41.206844 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:41.207272 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:41.207990 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:41.208442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:41.208862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:41.276443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:41.285707 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5192e1a2-3f52-4091-b56f-277568768c4e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1245 microversion: 2.1 time: 0.092155 Sep 23 01:39:41.286681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 478/953] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:41 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:41.388443 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:41.389170 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:41.395979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:41.396458 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:41.396893 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:41.397586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:41.398034 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:41.398452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:41.642501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:41.642501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-06e01472-c7a4-48a3-8c3f-edef71cb1302 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.227561 Sep 23 01:39:41.642501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 476/954] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:41 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:42.309715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:42.310423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:42.316853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.317338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.317780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.318544 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.318948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.319375 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.398676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:42.406987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a0eca11d-708c-40e2-9770-18b5ca13370c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1293 microversion: 2.1 time: 0.101281 Sep 23 01:39:42.407583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 479/955] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:42 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:42.570091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:42.570894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:42.580753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:42.597910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.597910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.598674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.599316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.599794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.600216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.605140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.606402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.607472 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.632796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:39:42.635942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] Creating event network-changed:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:39:42.643093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-b17444dd-2c6d-424c-8202-c4d03aa5faef req-e94b41c5-ff0b-4f4a-940f-c09fcfaee48c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069043 Sep 23 01:39:42.645097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 480/956] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:42.656838 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:42.658576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:42.670737 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.672161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.673216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.674796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.675565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.676368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.951033 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:42.955588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-951e0df4-5c40-4562-95c5-b06ebc94af3b tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "DELETE /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 204 len: 0 microversion: 2.1 time: 0.392695 Sep 23 01:39:42.956262 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 477/957] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:39:42 2022] DELETE /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:39:42.963034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-03139081-31af-49e5-87e3-d2c112eb4c52 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.314450 Sep 23 01:39:42.963777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 481/958] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:42 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:42.966044 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:42.966754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:42.973561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.974116 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.974537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:42.975338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:42.975714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:42.976135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:43.130883 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:43.139238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2bf6ace3-cdd9-4e2f-b35f-959af623fa93 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.178111 Sep 23 01:39:43.140091 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 478/959] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:42 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:43.431067 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:43.431746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:43.438055 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:43.438550 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:43.439189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:43.439936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:43.440561 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:43.441202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:43.584245 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:43.593624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-83ccb5cf-7e2b-4098-a8c6-a2db3ae29970 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1301 microversion: 2.1 time: 0.166910 Sep 23 01:39:43.594066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 482/960] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:43 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1301 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:43.987283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:43.987923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:43.994940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:43.995441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:43.995896 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:43.996579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:43.997041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:43.997453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:44.132549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:44.140416 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b12c5598-9d47-4519-a5ec-5be0f59857ba tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.157140 Sep 23 01:39:44.141039 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 479/961] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:43 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:44.162639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:44.163263 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:44.170369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:44.170861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:44.171294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:44.172038 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:44.172628 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:44.172908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:44.313277 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:44.320447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-63ae4951-6421-4b3b-b7ef-bb572a741e6a tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.161995 Sep 23 01:39:44.321028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 483/962] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:44 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:44.623580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:44.624929 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:44.634479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:44.635122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:44.635609 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:44.636331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:44.636786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:44.637209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:44.710367 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:44.715319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-47ab5f16-555c-487d-8bfe-894ff0237fae tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1311 microversion: 2.1 time: 0.099996 Sep 23 01:39:44.715991 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 480/963] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:44 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1311 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:45.168110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:45.168689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:45.175185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.175693 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.176124 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.176836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.177264 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.177677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.346834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:45.353132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:45.356766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.357346 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.357888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.358980 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.359577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.360122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.453330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:45.462425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-65370f59-9a98-4fd0-a1b9-8198130e549d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.300162 Sep 23 01:39:45.463597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 484/964] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:45 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:45.599205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:45.608388 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1fab6b1b-091c-487d-808e-deeb252c608d tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1565 microversion: 2.1 time: 0.266795 Sep 23 01:39:45.609137 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 481/965] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:45 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1565 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:45.741271 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:45.742433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:45.749016 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.749587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.750091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.750865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.751379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.751832 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.970987 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c50f9b-7a91-48fb-9390-2149364acd41", "name": "network-vif-deleted", "tag": "911afee1-5fd1-4032-b7a3-0dfc35cb6337"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:45.983250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:45.983250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:45.983764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:45.999746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] Creating event network-vif-deleted:911afee1-5fd1-4032-b7a3-0dfc35cb6337 for instance 35c50f9b-7a91-48fb-9390-2149364acd41 on hv-cinder-84914 Sep 23 01:39:46.002043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-799c2ec5-8533-43cc-9358-0aa59b282f29 req-eee41aa5-0c8e-4094-8028-4fa94feda379 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034799 Sep 23 01:39:46.002533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 482/966] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:39:46.022691 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:46.033126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-778b6ee8-a94f-4619-986e-610c685f4cf0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.295118 Sep 23 01:39:46.036811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 485/967] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:45 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:46.489848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:46.490462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:46.497121 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:46.497590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:46.498014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:46.498692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:46.499136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:46.499561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:46.632745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:46.633362 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:46.640918 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:46.641408 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:46.641841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:46.642541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:46.642989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:46.643409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:46.647365 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:46.651775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:46.656699 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d8ad2ff0-8cec-446d-aa1d-04b11981f7f5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.171522 Sep 23 01:39:46.661413 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 483/968] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:46 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:46.725500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:46.729643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:46.734288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6adcbe61-ba8b-43e9-b143-ef208d1e18ae tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1217 microversion: 2.1 time: 0.105733 Sep 23 01:39:46.734877 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 486/969] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:46 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1217 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:47.060608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:47.061125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:47.063631 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f798dc-4e0c-4d00-aaf1-981c818467d3", "tag": "a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:47.067740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.068232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.068663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.069367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.070126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.070566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.077182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.081183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.081183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.091684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] Creating event network-changed:a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5 for instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 on hv-cinder-84914 Sep 23 01:39:47.098483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-d3c8687e-c44c-4567-b7c4-441f8a7b8b91 req-db684a52-148d-4f8e-a892-a85b4a979cb3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042852 Sep 23 01:39:47.099490 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 484/970] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:47.330007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:47.338547 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-efa3d2a9-0e1f-4843-8ef3-cba0686048b1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.282600 Sep 23 01:39:47.339128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 487/971] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:47 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:47.682849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:47.684003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:47.690797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.691287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.691754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.692533 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.693181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.693800 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.757605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:47.758265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:47.769037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.769817 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.770405 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.772236 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.772869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.773467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.815920 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:47.816794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:47.817777 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:47.818261 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lazy-loading 'fault' on Instance uuid 35c50f9b-7a91-48fb-9390-2149364acd41 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:39:47.868858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:47.877908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-47019cdf-d438-4a2e-b6e5-fe105313e5e5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.200657 Sep 23 01:39:47.879825 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 485/972] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:47 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:47.890152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8089cf57e0014489a12e659278c2931e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '600dd39d7a7944a49330866c0e26cb66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:47.900134 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9993b857-a987-487b-b067-eec4c985e4ed tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 200 len: 1222 microversion: 2.1 time: 0.146355 Sep 23 01:39:47.900797 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 488/973] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:47 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 1222 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:48.363014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:48.363646 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:48.370700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.371354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.371863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.372623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.373080 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.373506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.512985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:48.520843 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-892a1ecf-a804-48e7-974d-74c675399c2d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.162091 Sep 23 01:39:48.521623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 486/974] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:48 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:48.904152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:48.904826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:48.911956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.912455 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.912873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.913569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.914018 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.914434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.926403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:48.926403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] [instance: 35c50f9b-7a91-48fb-9390-2149364acd41] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:48.932639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.933336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.933868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.934834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:48.935501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:48.936245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:48.952202 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] HTTP exception thrown: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Request method failure captured: Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 HTTP/1.1 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ0iG__mNhq1QTAcmqBw69xvtrlX-YDjadYKF3H_Le13R8t3IfkJivZa_6PsK59sqRiiU739mkMzV3m2JwNeMfU5I8ixfKhpCsdUzQe1dlsTGM5X6BZoXvfiO6gmMrQcFXs4QMYdI1YB-GPoikyqhLXxW3OZrwJVJuckSUOoykNI3_8 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 600dd39d7a7944a49330866c0e26cb66 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-TestShelveInstance-838713815 Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:39:48.954014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/600dd39d7a7944a49330866c0e26cb66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/600dd39d7a7944a49330866c0e26cb66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/600dd39d7a7944a49330866c0e26cb66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_600dd39d7a7944a49330866c0e26cb66", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-TestShelveInstance-838713815 Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 600dd39d7a7944a49330866c0e26cb66 Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-TestShelveInstance-838713815 Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-TestShelveInstance-838713815-project Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 8089cf57e0014489a12e659278c2931e Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-TestShelveInstance-838713815-project Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. Sep 23 01:39:48.955842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '35c50f9b-7a91-48fb-9390-2149364acd41'} Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:39:48.956837 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. Sep 23 01:39:48.958303 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:39:48.960560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Returning 404 to user: Instance 35c50f9b-7a91-48fb-9390-2149364acd41 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:39:48.961450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3ea7a1e3-5ecb-4fc6-a8c0-e9ee55c1d6d8 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41" status: 404 len: 111 microversion: 2.1 time: 0.041826 Sep 23 01:39:48.962220 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 487/975] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:48 2022] GET /compute/v2.1/servers/35c50f9b-7a91-48fb-9390-2149364acd41 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:39:49.031974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84ea01c-1bd5-4928-832e-e939c785fcb2", "name": "network-vif-plugged", "status": "completed", "tag": "76aa0f1b-1f50-4ed6-9407-e64aa3b79462"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:49.043249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:49.043793 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:49.044201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:49.058524 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] Creating event network-vif-plugged:76aa0f1b-1f50-4ed6-9407-e64aa3b79462 for instance d84ea01c-1bd5-4928-832e-e939c785fcb2 on hv-cinder-84914 Sep 23 01:39:49.064889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-35cbff7e-f146-40d3-b8b9-f38a973525c0 req-6439bf51-2c43-46b0-b44f-28850a7b95b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036310 Sep 23 01:39:49.066175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 488/976] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:39:49.083306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:49.091965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1cc9c245-52f9-40be-880d-3a6366cfc900 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.191830 Sep 23 01:39:49.092573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 489/977] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:48 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:49.252637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fcb90bb9-fbef-4253-a756-ccaf29d01f01 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] Calling method '.version_select at 0x7f7679412430>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:49.260897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:49.368865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fcb90bb9-fbef-4253-a756-ccaf29d01f01 tempest-TestShelveInstance-838713815 tempest-TestShelveInstance-838713815-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-559886363" status: 202 len: 0 microversion: 2.1 time: 0.120560 Sep 23 01:39:49.369707 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 489/978] 10.222.0.64 () {58 vars in 1251 bytes} [Fri Sep 23 01:39:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-559886363 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:39:49.545007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:49.545500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:49.552158 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:49.552655 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:49.553092 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:49.553790 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:49.554255 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:49.554679 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:49.692001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:49.700220 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a6a408c3-e595-4cad-b7e5-d2fd290fa427 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.159869 Sep 23 01:39:49.700789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 490/979] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:49 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:50.119742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:50.121327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=18 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:50.126401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:50.127161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:50.135799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:50.136301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:50.136758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:50.137496 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:50.137956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:50.138383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:50.371430 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:50.379481 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-932e986d-7ee3-4bb5-bfff-c28278d866ec tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1264 microversion: 2.1 time: 0.260473 Sep 23 01:39:50.380105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 490/980] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:50 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:50.725109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:50.725741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:50.729756 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:39:50.733343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:50.733840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:50.737147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:50.737147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:50.737147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:50.737147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:50.913175 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:50.922677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1344cd29-b047-49c1-9a4e-cd643023a4ea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.202701 Sep 23 01:39:50.924420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 491/981] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:50 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:51.405195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:51.406725 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:51.415368 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.416232 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.416853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:51.417564 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.418180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.418771 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:51.650629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:51.659786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6938cbe6-0e6e-4dd8-bc6a-06e69fea8409 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1451 microversion: 2.1 time: 0.259151 Sep 23 01:39:51.660423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 491/982] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:51 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1451 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:51.683246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:51.683983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:51.690404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.691019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.691526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:51.692496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.693029 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.693458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:51.844750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:51.855601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c0ab0540-09f7-441e-926e-17e4056c2abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1451 microversion: 2.1 time: 0.176198 Sep 23 01:39:51.859908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 492/983] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:51 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1451 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:51.948671 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:51.952864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:51.957734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.958487 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.959112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:51.960098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:51.960724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:51.961373 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:52.150525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:52.170958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4c204f7e-4bbe-4423-9f31-efa9eedcf9eb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.214669 Sep 23 01:39:52.170958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 492/984] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:51 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:53.188710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:53.189467 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:53.204952 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f798dc-4e0c-4d00-aaf1-981c818467d3", "name": "network-vif-plugged", "status": "completed", "tag": "a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:53.232681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:53.232681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:53.232681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:53.247605 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:53.250410 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:53.251383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:53.252308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:53.253312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:53.253917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:53.285526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] Creating event network-vif-plugged:a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5 for instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 on hv-cinder-84914 Sep 23 01:39:53.303218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-60be025d-3d0b-4fea-a3af-debb29da7d62 req-22059591-4947-438e-a22f-ae774cf54dad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103078 Sep 23 01:39:53.306374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 493/985] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:39:53.634221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:53.643771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-863a9688-434a-41ac-9d4c-a1e30500cab0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.464080 Sep 23 01:39:53.657468 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 493/986] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:53 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:54.670590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:54.673086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:54.682402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:54.682888 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:54.683325 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:54.684054 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:54.684497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:54.684915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:54.903429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:54.913756 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-06039da8-5f11-4e3c-8c7b-e526eee099db tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1367 microversion: 2.1 time: 0.247915 Sep 23 01:39:54.915431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 494/987] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:54 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:39:54.983411 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d84ea01c-1bd5-4928-832e-e939c785fcb2", "tag": "76aa0f1b-1f50-4ed6-9407-e64aa3b79462"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:55.004271 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:55.006027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:55.006651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:55.025246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] Creating event network-changed:76aa0f1b-1f50-4ed6-9407-e64aa3b79462 for instance d84ea01c-1bd5-4928-832e-e939c785fcb2 on hv-cinder-84914 Sep 23 01:39:55.033167 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-c0613d70-0f09-4744-86d8-c2c2bfd8e3b8 req-c4e22d77-6dab-41bc-85d9-ff5df27ebe34 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056710 Sep 23 01:39:55.034755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 494/988] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:55.941196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:55.943934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:55.957168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:55.958051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:55.958832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:55.960197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:55.961067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:55.962429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:56.182083 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:39:56.196580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dba5f8d9-39b5-49d9-9ec8-faa3d0897e13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1555 microversion: 2.1 time: 0.261661 Sep 23 01:39:56.197336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 495/989] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:39:55 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1555 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:39:56.221618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:39:56.222180 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:39:56.230385 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:56.230796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:56.231232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:56.231968 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:56.232553 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:56.233142 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:56.379377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1567cca4-da34-49c7-ac08-d36ed7485356 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.162530 Sep 23 01:39:56.380404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 495/990] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:39:56 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:39:57.707577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38f798dc-4e0c-4d00-aaf1-981c818467d3", "tag": "a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:39:57.720382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:39:57.721102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:39:57.721742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:39:57.737008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] Creating event network-changed:a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5 for instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 on hv-cinder-84914 Sep 23 01:39:57.746074 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e0a8fda4-a014-4622-95d6-fb1b91fd4729 req-c1f38d91-52a9-4735-9309-98b827c3a6b8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041966 Sep 23 01:39:57.751629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 496/991] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:34.038073 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=62 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:34.038789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=50 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:34.039591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:40:34.041584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Fri Sep 23 01:40:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/ips (ip 10.222.0.64) !!! Sep 23 01:40:34.055128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:34.055782 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:34.065661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.066186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.066627 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.067330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.067810 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.068232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.117596 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-444f0e10-ba01-4bb8-bee6-52db5abb8f13 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/ips" status: 200 len: 147 microversion: 2.1 time: 0.081015 Sep 23 01:40:34.119042 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 496/992] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:40:34 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/ips => generated 147 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:34.133438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:34.134696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=52 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:40:34.139838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d140d2f2-16ff-4f21-bf3c-513e8b8592ac"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:34.142666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:34.150287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.150817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.151252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.152033 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.152713 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.153183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.259152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: POST /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/os-volume_attachments HTTP/1.1 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 74 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:40:34.261081 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {"volumeAttachment": {"volumeId": "d140d2f2-16ff-4f21-bf3c-513e8b8592ac"}} Sep 23 01:40:34.263439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'server_id': '38f798dc-4e0c-4d00-aaf1-981c818467d3', 'body': {'volumeAttachment': {'volumeId': 'd140d2f2-16ff-4f21-bf3c-513e8b8592ac'}}} Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:40:34.265098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:34.268231 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 400 to user: Invalid volume: volume d140d2f2-16ff-4f21-bf3c-513e8b8592ac is already attached to instances: b9aa9456-2386-4774-acb6-bce201e6d94d {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b67299d5-6219-4e09-bb10-82abc30ddccf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.132019 Sep 23 01:40:34.271638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 497/993] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:40:34 2022] POST /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3/os-volume_attachments => generated 174 bytes in 134 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 23 01:40:34.275444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:34.275985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:34.283980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.284627 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.285161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.285978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.286532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.287171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.320198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:40:34.652382 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-aa326e0c-1c1a-443d-8aab-9b20179ad3b2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 204 len: 0 microversion: 2.1 time: 0.382647 Sep 23 01:40:34.653288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 497/994] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:40:34 2022] DELETE /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:40:34.664774 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:34.665465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:34.673016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.673503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.673932 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.674639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:34.675150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:34.675605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:34.845717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:34.857613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2d3d0962-b34b-4eae-9979-a6c96ed0f838 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1679 microversion: 2.1 time: 0.198465 Sep 23 01:40:34.858803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 498/995] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:34 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1679 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:35.896418 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:35.897274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:35.905773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:35.906386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:35.907495 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:35.908624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:35.909163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:35.909687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:36.080270 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:36.088317 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-99220930-6f7f-42fd-8125-08dcad9b8606 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1679 microversion: 2.1 time: 0.196719 Sep 23 01:40:36.088912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 498/996] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:35 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:37.114876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:37.116944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:37.123902 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:37.124830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:37.125811 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:37.126955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:37.128540 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:37.129330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:37.225211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:37.243077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9e2be9bb-a26e-4b51-a7fd-b2479530a08f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1611 microversion: 2.1 time: 0.132607 Sep 23 01:40:37.244292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 499/997] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:37 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1611 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:37.918818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38f798dc-4e0c-4d00-aaf1-981c818467d3", "name": "network-vif-deleted", "tag": "a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:37.933794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:37.937278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:37.937278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:37.951532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] Creating event network-vif-deleted:a5c177e6-c0d0-4d46-8bb7-026c0c47c4e5 for instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 on hv-cinder-84914 Sep 23 01:40:37.958183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-d41bf732-e763-4467-a6ff-244a27776a67 req-11a14910-47c0-4e4f-8fc3-87bf8fac571a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374565 Sep 23 01:40:37.959947 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 499/998] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:38.296025 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:38.296978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:38.309745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:38.310576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:38.311339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:38.312613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:38.314247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:38.315939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:38.378255 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:38.379146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:38.379988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:38.380817 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'fault' on Instance uuid 38f798dc-4e0c-4d00-aaf1-981c818467d3 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:40:38.443704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:38.453195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a79106a8-73a5-41b9-ab6c-235baeb611c2 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 200 len: 1331 microversion: 2.1 time: 0.164997 Sep 23 01:40:38.454491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 500/999] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:38 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:39.481050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:39.481919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:39.489751 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:39.490388 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:39.490924 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:39.491844 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:39.492435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:39.492971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:39.510025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 HTTP/1.1 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:40:39.511906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:40:39.514819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '38f798dc-4e0c-4d00-aaf1-981c818467d3'} Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:40:39.516564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:40:39.518928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:39.521097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:40:39.521097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2c32e06f-1055-415e-9cba-b0bcb37a3129 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 404 len: 111 microversion: 2.1 time: 0.038433 Sep 23 01:40:39.521097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 500/1000] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:39 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:40:39.524559 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-aec205d9-3f59-4d7c-af0a-9988fec1139f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '.version_select at 0x7f767920db80>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:39.624669 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-aec205d9-3f59-4d7c-af0a-9988fec1139f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249438192" status: 202 len: 0 microversion: 2.1 time: 0.104214 Sep 23 01:40:39.626139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 501/1001] 10.222.0.64 () {58 vars in 1221 bytes} [Fri Sep 23 01:40:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1249438192 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:40:40.878898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:40.879504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:40.886334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:40.886820 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:40.887259 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:40.887992 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:40.888506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:40.888928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:40.992394 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'services' on Instance uuid b9aa9456-2386-4774-acb6-bce201e6d94d {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:40:41.212372 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9a537a9b-d046-4f98-94df-8a5c13940d76 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments/d140d2f2-16ff-4f21-bf3c-513e8b8592ac" status: 202 len: 0 microversion: 2.1 time: 0.339195 Sep 23 01:40:41.212883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 501/1002] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:40:40 2022] DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments/d140d2f2-16ff-4f21-bf3c-513e8b8592ac => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:40:41.223113 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:41.226576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:41.234390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:41.236676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:41.236676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:41.237525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:41.237525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:41.238456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:41.274209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a8464353-d536-41b5-9560-a71326d5c165 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056185 Sep 23 01:40:41.275014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 502/1003] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:40:41 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:42.287997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:42.290351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:42.297658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:42.298157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:42.298604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:42.299310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:42.299806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:42.300229 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:42.334319 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a38de7bf-6b6a-402b-8465-7a44fd3a3c67 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051198 Sep 23 01:40:42.334895 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 502/1004] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:40:42 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:43.350326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:43.352509 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:43.359177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.359697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.360125 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:43.360818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.361297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.361717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:43.396366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-88dc6a9d-92d2-4575-b328-3a3e933f8f95 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050277 Sep 23 01:40:43.396999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 503/1005] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:40:43 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:40:43.466705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:43.467298 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:43.474386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.474890 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.475336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:43.476096 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.476568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.477027 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:43.506506 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:40:43.828439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f99e6cbc-3442-46e4-9812-cb10275a358c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 204 len: 0 microversion: 2.1 time: 0.366483 Sep 23 01:40:43.829343 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 503/1006] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:40:43 2022] DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:40:43.842149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:43.842830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:43.850465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.850972 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.851415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:43.855216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:43.855216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:43.855216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:44.028180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:44.041749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-091feb62-7026-4708-834b-689e144fdb49 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1680 microversion: 2.1 time: 0.203082 Sep 23 01:40:44.042720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 504/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:43 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1680 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:45.069631 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:45.070326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:45.077739 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:45.078220 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:45.078654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:45.079412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:45.079888 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:45.080361 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:45.266670 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:45.276265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c1c739d4-b0d7-42a4-b874-b6236a4da1c7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1680 microversion: 2.1 time: 0.210819 Sep 23 01:40:45.276851 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 504/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:45 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1680 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:40:46.301136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:46.301739 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:46.308624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:46.309107 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:46.309537 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:46.310239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:46.310701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:46.311154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:46.451297 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:46.460244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-735b8e53-b82f-48dc-883e-d8e148d30625 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1680 microversion: 2.1 time: 0.162959 Sep 23 01:40:46.460842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 505/1009] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:46 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:46.755213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9aa9456-2386-4774-acb6-bce201e6d94d", "name": "network-vif-deleted", "tag": "71b6fced-1490-49f1-9d45-9f897ad02832"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:46.765274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:46.765748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:46.766173 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:46.777584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] Creating event network-vif-deleted:71b6fced-1490-49f1-9d45-9f897ad02832 for instance b9aa9456-2386-4774-acb6-bce201e6d94d on hv-cinder-84914 Sep 23 01:40:46.783206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-34a3c6c1-c88a-49d7-82ba-72ddffd7654f req-467b4863-6955-4592-aaa4-e217e1aa64a8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Sep 23 01:40:46.784131 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 505/1010] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:47.484995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:47.485721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:47.492478 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:47.492957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:47.493392 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:47.494129 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:47.494529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:47.494953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:47.528523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:47.528929 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:47.529350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:47.529797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'fault' on Instance uuid b9aa9456-2386-4774-acb6-bce201e6d94d {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:40:47.572306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:47.581366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-587f5503-3c4f-4174-a8e3-f0a117c33224 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 200 len: 1331 microversion: 2.1 time: 0.100125 Sep 23 01:40:47.581957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 506/1011] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:47 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:48.606772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:48.607462 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:48.614538 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:48.615019 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:48.615443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:48.616159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:48.616604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:48.617021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:48.630383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d HTTP/1.1 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:40:48.632085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:40:48.633803 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'b9aa9456-2386-4774-acb6-bce201e6d94d'} Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:40:48.634812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:40:48.636514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:40:48.637956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:40:48.637956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d76e2264-7fea-4483-bddc-b048aa58306b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 404 len: 111 microversion: 2.1 time: 0.031516 Sep 23 01:40:48.637956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 506/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:48 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:40:48.642453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2c1d7447-94ef-4df2-beb3-a2a7b684329c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '.version_select at 0x7f76793af4c0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:48.732126 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2c1d7447-94ef-4df2-beb3-a2a7b684329c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-224575336" status: 202 len: 0 microversion: 2.1 time: 0.093378 Sep 23 01:40:48.732743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 507/1013] 10.222.0.64 () {58 vars in 1218 bytes} [Fri Sep 23 01:40:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-224575336 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:40:49.525937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c7b8d716-7654-4106-b5fd-e2675dafc11b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: .version_select at 0x7f7678f2b940>, body: {"keypair": {"name": "tempest-keypair-2093931865", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA5ObrG5Avg7+0bWplQiwip9bhtue/Qthl9WRalT99jNM0cxNR4TYNWOpXN498JDwvmXNoQG88MrnXnTNjVLBvtd+YhEbeiD/cQCPY8pZRJOf7x4HhVRIFTK8uKvDI1Pw=="}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:49.542565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-c7b8d716-7654-4106-b5fd-e2675dafc11b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:40:49.546476 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-c7b8d716-7654-4106-b5fd-e2675dafc11b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:40:49.629623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c7b8d716-7654-4106-b5fd-e2675dafc11b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.107675 Sep 23 01:40:49.630387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 507/1014] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:40:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:52.343460 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-818847953", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "970b65ab-4e22-445a-8ff5-01dfad2a0bf4"}], "security_groups": [{"name": "tempest-securitygroup--990866243"}], "key_name": "tempest-keypair-2093931865", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:52.466566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] validate_networks() for [('970b65ab-4e22-445a-8ff5-01dfad2a0bf4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:40:52.975043 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:40:52.975462 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:40:52.975957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:40:52.976356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:40:52.976775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:40:52.986088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:52.986590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:52.987020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:52.987776 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:52.988245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:52.988658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:53.005670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:40:53.010176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:40:53.022918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:40:53.025352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:40:53.152424 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-144c9463-2903-45a7-adcd-ab802275142b tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.814096 Sep 23 01:40:53.153090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 508/1015] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:40:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:40:53.165106 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1f895351-e8c2-48c2-8f9c-eb751fc622d6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:53.166012 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1f895351-e8c2-48c2-8f9c-eb751fc622d6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:53.230480 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1f895351-e8c2-48c2-8f9c-eb751fc622d6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:53.251826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1f895351-e8c2-48c2-8f9c-eb751fc622d6 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1241 microversion: 2.1 time: 0.077819 Sep 23 01:40:53.251826 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 508/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:53 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:54.262691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:54.263301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:54.270617 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:54.271104 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:54.271621 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:54.272324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:54.272782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:54.273206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:54.343871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:54.352163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d07b86c4-0195-4a8f-8d11-a629d6513b40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1245 microversion: 2.1 time: 0.093440 Sep 23 01:40:54.352730 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 509/1017] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:54 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:55.374772 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:55.375435 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:55.382369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:55.382856 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:55.383289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:55.384066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:55.384525 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:55.384948 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:55.450143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:55.458765 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bf0c0949-2447-411e-9e87-4069ef4f6334 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1293 microversion: 2.1 time: 0.088087 Sep 23 01:40:55.459344 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 509/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:55 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:56.483453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:56.484094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:56.490910 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:56.491400 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:56.496551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:56.496551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:56.496551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:56.496551 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:56.571539 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:56.579737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-212df337-0bcf-4562-9442-bd752b828831 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1299 microversion: 2.1 time: 0.100276 Sep 23 01:40:56.583798 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 510/1019] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:56 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:57.604353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:57.604949 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:57.612589 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:57.613079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:57.613515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:57.614227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:57.614681 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:57.615104 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:57.786058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7140fb1a-d0fd-4874-8777-ec98b34bae21", "tag": "690df2c8-236b-4045-91f7-d0bced1c939f"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:40:57.787821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:57.797265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:57.797582 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d149feac-5185-4a3c-bfc2-f4acb3c21368 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.197372 Sep 23 01:40:57.798280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:57.798718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:57.801868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 510/1020] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:57 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:40:57.817629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] Creating event network-changed:690df2c8-236b-4045-91f7-d0bced1c939f for instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 on hv-cinder-84914 Sep 23 01:40:57.823179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-5d9eda56-f2e5-4bd5-b8a1-28dc6783c235 req-3dffdfff-10f2-40f1-a162-0f0a27021f18 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042625 Sep 23 01:40:57.824017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 511/1021] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:40:58.822379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:40:58.822970 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:40:58.831191 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:58.831720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:58.832154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:58.832863 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:40:58.833322 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:40:58.833902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:40:59.008318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:40:59.016730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9037a566-cb51-44df-9658-9057577df24f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.198256 Sep 23 01:40:59.017318 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 511/1022] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:40:58 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:00.043918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:00.044652 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:00.051214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:00.051831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:00.052162 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:00.052857 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:00.053306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:00.053724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:00.191755 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:00.199880 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-85314b4a-5fca-48db-9123-6829a958a9cf tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.160800 Sep 23 01:41:00.200476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 512/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:00 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:01.223376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:01.224363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:01.231576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:01.232101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:01.232532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:01.233232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:01.233687 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:01.234108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:01.437768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:01.448349 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-225ec977-fef2-43bf-9b7f-f3cb543965e3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.229307 Sep 23 01:41:01.449147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 512/1024] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:01 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:41:02.472514 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:02.473645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:02.483189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:02.483735 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:02.484197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:02.484904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:02.485356 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:02.485771 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:02.630464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:02.637361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-27ef5f39-3590-4bfd-b24b-e6a51010729e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.168761 Sep 23 01:41:02.637956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 513/1025] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:02 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:03.491903 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7140fb1a-d0fd-4874-8777-ec98b34bae21", "name": "network-vif-plugged", "status": "completed", "tag": "690df2c8-236b-4045-91f7-d0bced1c939f"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:03.501828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=6 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:03.503897 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:03.504359 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:03.504792 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:03.516893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] Creating event network-vif-plugged:690df2c8-236b-4045-91f7-d0bced1c939f for instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 on hv-cinder-84914 Sep 23 01:41:03.522763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-3c59c7e3-8610-4aaa-8b09-3e7f20b3c42c req-3831d49d-0634-4a17-a151-3e015da9b83a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034653 Sep 23 01:41:03.532336 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 513/1026] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:03.662790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:03.663389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:03.666538 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:03.667225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=6 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:03.672834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:03.674521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:03.674521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:03.675105 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:03.675582 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:03.676014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:03.835086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:03.845647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-26d8ed21-eacc-495a-95df-99830e53586d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.185508 Sep 23 01:41:03.845647 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 514/1027] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:03 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:04.869515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:04.870288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:04.872586 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:04.877886 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:04.878363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:04.878796 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:04.879490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:04.879975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:04.880392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:04.883240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:05.037025 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:05.046466 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-09869484-cac4-4a42-a5e2-91bc22881142 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1366 microversion: 2.1 time: 0.181560 Sep 23 01:41:05.047048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 514/1028] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:04 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:06.075520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:06.076554 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:06.079858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:06.085201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:06.085697 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:06.086130 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:06.086853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:06.087302 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:06.087758 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:06.092226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=93 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:06.228512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:06.237260 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2034123c-b3f2-41a7-b468-509c9e7385c9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1553 microversion: 2.1 time: 0.168740 Sep 23 01:41:06.243149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 515/1029] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:06 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:06.261353 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:06.261934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:06.269493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:06.270017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:06.270564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:06.271278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:06.271770 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:06.272197 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:06.357321 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-30d7132e-a2b9-4aaa-9125-41ce7254179c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099862 Sep 23 01:41:06.357915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 515/1030] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:41:06 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:07.491431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7140fb1a-d0fd-4874-8777-ec98b34bae21", "tag": "690df2c8-236b-4045-91f7-d0bced1c939f"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:07.501577 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:07.502148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:07.502495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:07.513937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] Creating event network-changed:690df2c8-236b-4045-91f7-d0bced1c939f for instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 on hv-cinder-84914 Sep 23 01:41:07.519645 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-c2b2c310-d148-4da8-9866-60a947a76767 req-698e761a-2be3-42f9-8b0b-a51d4e4b5490 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096441 Sep 23 01:41:07.520258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 516/1031] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:42.454049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:42.454921 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=9 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:42.458976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:42.459473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:42.465615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:42.466097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:42.466533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:42.467230 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:42.467715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:42.471179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:42.491509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b6001596-dcfc-498a-b703-033dce83343e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/ips" status: 200 len: 147 microversion: 2.1 time: 0.039001 Sep 23 01:41:42.492103 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 516/1032] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:41:42 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/ips => generated 147 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:44.193016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=7 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:44.193835 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:41:44.198764 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732eb16b-1310-4711-9ff7-07d8384d1cea"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:44.201845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:44.208009 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:44.208488 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:44.208914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:44.209599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:44.210041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:44.210454 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:45.044127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8ef0b8c3-eca3-4941-bf82-82ca01cde646 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852523 Sep 23 01:41:45.044808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 517/1033] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:41:44 2022] POST /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:50.640959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:50.641568 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:50.648815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:50.649295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:50.649730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:50.650415 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:50.650867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:50.651297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:50.680065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:41:51.118898 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-7a66eaac-753a-450b-bf02-9bb67e6fef34 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 204 len: 0 microversion: 2.1 time: 0.481888 Sep 23 01:41:51.119489 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 517/1034] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:41:50 2022] DELETE /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:41:51.129820 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:51.163001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:51.163001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:51.163001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:51.163001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:51.163457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:51.163457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:51.163457 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:51.294440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:51.294440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dc6d3be6-1cbe-4d27-a09e-199c81beebf9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1576 microversion: 2.1 time: 0.166248 Sep 23 01:41:51.294440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 518/1035] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:51 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:52.316934 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:52.317637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:52.324451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:52.324937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:52.325369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:52.326107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:52.326553 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:52.327539 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:52.468565 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:52.477715 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-83cf9822-47df-4792-8e5b-a8dd6eaa9925 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1576 microversion: 2.1 time: 0.165093 Sep 23 01:41:52.478308 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 518/1036] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:52 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:53.502518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:53.505292 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:53.513138 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:53.513630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:53.514568 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:53.515375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:53.515876 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:53.516406 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:54.039483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:54.048952 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-55e61057-f4d9-45aa-868b-00be87e31ea0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1576 microversion: 2.1 time: 0.550286 Sep 23 01:41:54.049626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 519/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:53 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1576 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:54.702505 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d84ea01c-1bd5-4928-832e-e939c785fcb2", "name": "network-vif-deleted", "tag": "76aa0f1b-1f50-4ed6-9407-e64aa3b79462"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:54.713724 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:54.714306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:54.714967 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:54.729634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] Creating event network-vif-deleted:76aa0f1b-1f50-4ed6-9407-e64aa3b79462 for instance d84ea01c-1bd5-4928-832e-e939c785fcb2 on hv-cinder-84914 Sep 23 01:41:54.738611 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-a13eaa23-e842-4c57-ac9b-6f430a1e0f6a req-6735c31f-9a0c-4e93-8e12-4f87c8114a53 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040266 Sep 23 01:41:54.740023 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 519/1038] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:54.789611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "732eb16b-1310-4711-9ff7-07d8384d1cea"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:54.792822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:54.801177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:54.802175 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:54.802649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:54.803526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:54.804368 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:54.804940 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:54.917726 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: POST /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments HTTP/1.1 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 74 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:41:54.921098 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {"volumeAttachment": {"volumeId": "732eb16b-1310-4711-9ff7-07d8384d1cea"}} Sep 23 01:41:54.923005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'server_id': '7140fb1a-d0fd-4874-8777-ec98b34bae21', 'body': {'volumeAttachment': {'volumeId': '732eb16b-1310-4711-9ff7-07d8384d1cea'}}} Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:41:54.924989 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:54.926721 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 400 to user: Invalid volume: volume 732eb16b-1310-4711-9ff7-07d8384d1cea is already attached to instances: 7140fb1a-d0fd-4874-8777-ec98b34bae21 {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:41:54.928359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d2d5c974-aecb-474e-b928-2e2500e4bee5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.138464 Sep 23 01:41:54.931399 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 520/1039] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:41:54 2022] POST /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 23 01:41:55.015091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:55.015713 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:55.022719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.023697 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.023855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.024590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.025052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.025478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.074548 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:55.075319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:55.084854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.085470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.086050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.086854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.087471 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.087994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.157184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'services' on Instance uuid 7140fb1a-d0fd-4874-8777-ec98b34bae21 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:41:55.193599 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:55.199186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-62ad38d8-5cce-4911-9e7b-6e53a84fc650 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1224 microversion: 2.1 time: 0.129899 Sep 23 01:41:55.200122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 521/1040] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:55 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:55.547117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b0c37e00-8870-40ff-a884-833f402c0bb7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments/732eb16b-1310-4711-9ff7-07d8384d1cea" status: 202 len: 0 microversion: 2.1 time: 0.536469 Sep 23 01:41:55.547776 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 520/1041] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:41:55 2022] DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments/732eb16b-1310-4711-9ff7-07d8384d1cea => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:41:55.556512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:55.558990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:55.566491 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.567096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.567666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.568475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:55.568992 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:55.569472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:55.612063 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-176d2c4d-fc5c-4a10-8bc1-476d0a29cbc3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059730 Sep 23 01:41:55.612986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 522/1042] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:41:55 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:56.223830 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:56.224894 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:56.232093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:56.232508 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:56.233443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:56.234150 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:56.234651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:56.235077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:56.268606 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:56.269094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:56.269526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:56.269979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lazy-loading 'fault' on Instance uuid d84ea01c-1bd5-4928-832e-e939c785fcb2 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:41:56.323157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:56.332712 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-431ad96c-39d8-4836-92de-0301f5c90249 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 200 len: 1229 microversion: 2.1 time: 0.114389 Sep 23 01:41:56.333312 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 521/1043] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:56 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:56.625426 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:56.628389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:56.638429 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:56.639655 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:56.639994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:56.641076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:56.641696 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:56.642295 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:56.678911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-006730da-30be-4b11-bcd3-d9c96e6dda02 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057396 Sep 23 01:41:56.679666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 523/1044] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:41:56 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:41:57.356247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:57.356858 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:57.363464 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.363989 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.364427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.365117 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.365573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.365996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.380037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] HTTP exception thrown: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Request method failure captured: Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 HTTP/1.1 Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4teQjXQY_Cjs76AnXKIqf_hPudbm4xQwxm-rdFrdBczb4Kfk30vMs9ANIrT0_tdDUsByOg_eT8a54aKcWZUELiazuZv5ggVRdGO6fmiTfSBCg9-3Unhvzs3l5lVvILgJe43nQsxOeiLuJ5aZHuMoN68n0gh-svQyvwnQRBT7GJank Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:41:57.381718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5c5ef59b1b44d8a916be97d8d11493f", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-TestVolumeBootPattern-9221964 Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: ad7c407cfe924b7a8652f8387c7f77b4 Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:41:57.383843 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'd84ea01c-1bd5-4928-832e-e939c785fcb2'} Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:41:57.384902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:41:57.386591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:41:57.388034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Returning 404 to user: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:41:57.388034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-84b15b8c-18f7-4c9e-a7f3-5fce0c354179 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 404 len: 111 microversion: 2.1 time: 0.030814 Sep 23 01:41:57.388034 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 522/1045] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:57 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:41:57.508754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-658865485", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-277631498", "security_groups": [{"name": "tempest-secgroup-smoke-309655662"}], "block_device_mapping_v2": [{"uuid": "a1c54760-d294-4862-9a29-b4e542fba139", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1919f-1f3e-419a-91a3-220386faadcd"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:41:57.644939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] validate_networks() for [('7fe1919f-1f3e-419a-91a3-220386faadcd', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:41:57.692644 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:57.694871 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:57.701324 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.701840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.702478 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.703241 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.703741 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.704185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.737692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-4cd1e3bb-e29a-4d29-884d-559105b64c9f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049206 Sep 23 01:41:57.738268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 523/1046] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:41:57 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 01:41:57.809315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:57.809854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:57.817349 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.817916 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.818393 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.819095 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:57.819559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:57.820003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:57.854037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:41:58.049892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:41:58.050318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:41:58.050784 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:41:58.051186 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:41:58.051657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:41:58.061873 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:58.062355 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:58.062787 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:58.063515 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:58.063988 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:58.064465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:58.081523 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:41:58.087408 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for user ad7c407cfe924b7a8652f8387c7f77b4 and project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:41:58.150974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:41:58.153159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a1c54760-d294-4862-9a29-b4e542fba139',volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:41:58.170959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8c3e291d-7c17-4816-b4a6-f91721fab902 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 204 len: 0 microversion: 2.1 time: 0.364811 Sep 23 01:41:58.171602 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 524/1047] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:41:57 2022] DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 01:41:58.181228 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:58.182036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:58.188348 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:58.188918 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:58.189428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:58.190194 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:58.190658 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:58.191089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:58.328007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:58.335716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a6eb0e30-9f39-4290-bca6-2313e8fdef7c tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1678 microversion: 2.1 time: 0.158818 Sep 23 01:41:58.336276 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 525/1048] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:58 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:41:58.560163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b1d9da54-041c-4cf5-866a-b5eacb091c7c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.055826 Sep 23 01:41:58.560810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 524/1049] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:41:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:41:58.575061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b5df2f2e-6010-41c8-bbf2-ef4bf82429b7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:58.575061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b5df2f2e-6010-41c8-bbf2-ef4bf82429b7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:58.652350 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b5df2f2e-6010-41c8-bbf2-ef4bf82429b7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:58.665083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b5df2f2e-6010-41c8-bbf2-ef4bf82429b7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1093 microversion: 2.1 time: 0.095775 Sep 23 01:41:58.666107 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 526/1050] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:58 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1093 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:59.361644 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:59.362371 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:59.368838 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:59.369347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:59.369763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:59.370469 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:59.370920 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:59.371345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:59.522661 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:59.533254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c82a7103-82a8-457c-b502-52083b85ffea tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1678 microversion: 2.1 time: 0.176728 Sep 23 01:41:59.533917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 525/1051] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:59 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:41:59.701196 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:41:59.701845 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:41:59.709555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:59.710093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:59.710569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:59.711338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:41:59.711827 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:41:59.712288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:41:59.779386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:41:59.787811 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8c41e590-e499-4e19-bd9f-d56edfa0392a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1143 microversion: 2.1 time: 0.090692 Sep 23 01:41:59.788379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 527/1052] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:41:59 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1143 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:00.558342 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:00.559053 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:00.566474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:00.566956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:00.567390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:00.568114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:00.568557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:00.568969 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:00.789557 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:00.800182 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a81b2cd4-d493-4352-b018-fff4571d365d tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1678 microversion: 2.1 time: 0.246098 Sep 23 01:42:00.806412 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 526/1053] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:00 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:00.817660 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:00.818650 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:00.826235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:00.829590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:00.829590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:00.829590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:00.830309 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:00.831819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:00.913686 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:00.924688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ed28ad66-a287-4dd9-a83b-0d00eee663fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1191 microversion: 2.1 time: 0.111203 Sep 23 01:42:00.929959 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 528/1054] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:00 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1191 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:01.123931 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7140fb1a-d0fd-4874-8777-ec98b34bae21", "name": "network-vif-deleted", "tag": "690df2c8-236b-4045-91f7-d0bced1c939f"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:01.140351 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.141020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.141752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.155822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] Creating event network-vif-deleted:690df2c8-236b-4045-91f7-d0bced1c939f for instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 on hv-cinder-84914 Sep 23 01:42:01.167041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-a481a244-826c-4766-a4c4-99917816f25e req-dedf2421-dda4-447a-b046-58e2d16560e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048645 Sep 23 01:42:01.169737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 527/1055] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:01.844557 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:01.848050 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:01.858835 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.860299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.860590 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.861661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.862268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.862636 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.902453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.903303 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.904030 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.905001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'fault' on Instance uuid 7140fb1a-d0fd-4874-8777-ec98b34bae21 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:42:01.951071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:01.952316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:01.961459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.962397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.965684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.965684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:01.965684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:01.965684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:01.983516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:02.011672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9b61700a-3b38-4766-a4f9-90a3af25daf9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 200 len: 1331 microversion: 2.1 time: 0.171571 Sep 23 01:42:02.028500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 529/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:01 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:02.078885 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:02.087010 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ec273e5a-227c-46e3-ac8c-c0edb86097bd tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1209 microversion: 2.1 time: 0.142351 Sep 23 01:42:02.089006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 528/1057] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:01 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1209 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:03.053132 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:03.053755 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:03.060819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:03.061231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:03.061672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:03.062387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:03.062961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:03.063584 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:03.097326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 HTTP/1.1 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:42:03.099711 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:42:03.101221 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '7140fb1a-d0fd-4874-8777-ec98b34bae21'} Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:42:03.102005 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:42:03.103252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:42:03.104936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:42:03.104936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f1f351fb-66a6-4eb0-9e7d-aab3fed06c86 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 404 len: 111 microversion: 2.1 time: 0.052271 Sep 23 01:42:03.104936 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 530/1058] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:03 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:42:03.113827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:03.114520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:03.117153 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-27ec0aa8-10c4-49e9-8b38-e4529a3a96cb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '.version_select at 0x7f7678f2b280>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:03.125165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:03.126166 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:03.126576 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:03.127493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:03.128179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:03.128746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:03.235007 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-27ec0aa8-10c4-49e9-8b38-e4529a3a96cb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093931865" status: 202 len: 0 microversion: 2.1 time: 0.125117 Sep 23 01:42:03.236297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 531/1059] 10.222.0.64 () {58 vars in 1221 bytes} [Fri Sep 23 01:42:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2093931865 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 23 01:42:03.316962 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:03.325048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-282ff724-abb5-4c52-b4f4-0254150d0b5c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1276 microversion: 2.1 time: 0.217329 Sep 23 01:42:03.325957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 529/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:03 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1276 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:03.503183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd592cb5-a798-4609-9b39-4fd6b3e83ac0", "tag": "52a7bbe8-2f75-4994-b4db-2f20bb798cea"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:03.517164 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:03.518037 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:03.518400 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:03.523268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:03.543819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] Creating event network-changed:52a7bbe8-2f75-4994-b4db-2f20bb798cea for instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 on hv-cinder-84914 Sep 23 01:42:03.555532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-522e7561-ce1c-4535-92e1-4731592b85d2 req-5e8cba2b-1c5a-4a0a-a636-9d946c409edf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057552 Sep 23 01:42:03.559879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 532/1061] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:04.183238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6152f5a5-c68e-45c1-b0e4-99471096a0a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: .version_select at 0x7f767925c9d0>, body: {"keypair": {"name": "tempest-keypair-1433064652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFxJmUnvwJei+eCVR4p2n2YMh0ag9zJB3WqxjmDNEdxa19I4ccihovqwsNnc9wD/TgK6ybXeAr8GjIAF+t7eutuHgBoL4RVlRgbDaUFcUg4buLzYevBH0AL6ubu2ZmsYQ=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:04.200203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-6152f5a5-c68e-45c1-b0e4-99471096a0a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:42:04.204960 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-6152f5a5-c68e-45c1-b0e4-99471096a0a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:42:04.304158 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6152f5a5-c68e-45c1-b0e4-99471096a0a9 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124797 Sep 23 01:42:04.304820 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 530/1062] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:42:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:04.351165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:04.351906 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:04.364639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:04.364639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:04.364639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:04.364639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:04.365371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:04.365371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:04.513297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:04.522195 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6ea6460a-7261-4b4f-813f-b463055316f6 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.175975 Sep 23 01:42:04.522985 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 533/1063] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:04 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:05.547604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:05.548219 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:05.555200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:05.561688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:05.561688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:05.561688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:05.561688 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:05.562189 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:05.706917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:05.716072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1bd472a4-fead-495e-8c20-161608b88c10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.173338 Sep 23 01:42:05.716710 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 531/1064] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:05 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:42:06.740818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:06.741443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:06.748164 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:06.749227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:06.749668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:06.750402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:06.750861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:06.751286 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:06.752848 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1229279196", "imageRef": "a3726a1b-d3f2-4f87-86b7-f8f8fc35b546", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "970b65ab-4e22-445a-8ff5-01dfad2a0bf4"}], "security_groups": [{"name": "tempest-securitygroup--1489442384"}], "key_name": "tempest-keypair-1433064652", "user_data": "}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:06.866206 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] validate_networks() for [('970b65ab-4e22-445a-8ff5-01dfad2a0bf4', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:42:06.893364 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:06.901689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-63bd7a1e-e962-4ad5-964d-837e90213b2f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.165567 Sep 23 01:42:06.902469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 534/1065] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:06 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:07.269521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:42:07.270102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:42:07.270567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:42:07.271045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:42:07.271452 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:42:07.281298 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:07.281775 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:07.282207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:07.282923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:07.283368 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:07.283830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:07.301911 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:42:07.305970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Getting quotas for user 3ce3e8c1e4f84274a1f5edb940ea4454 and project a15460898c2b4b15bfee3d39a01273b4. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:42:07.319138 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:42:07.323314 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a3726a1b-d3f2-4f87-86b7-f8f8fc35b546',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:42:07.465077 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ad2f88e8-1dc5-4ab3-b166-31da0934a342 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.717786 Sep 23 01:42:07.465729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 532/1066] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:42:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 719 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 23 01:42:07.477875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a3c79a06-1b88-4007-b052-0caf21887ad0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:07.478483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a3c79a06-1b88-4007-b052-0caf21887ad0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:07.539128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a3c79a06-1b88-4007-b052-0caf21887ad0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:07.546834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a3c79a06-1b88-4007-b052-0caf21887ad0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1242 microversion: 2.1 time: 0.073033 Sep 23 01:42:07.547632 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 535/1067] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:07 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:07.925717 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:07.926440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:07.933553 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:07.934041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:07.934483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:07.935181 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:07.935661 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:07.936086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:08.079241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:08.087210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e28c5c22-9c0e-48a5-93bb-ccbb51e68fb7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.165989 Sep 23 01:42:08.087830 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 533/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:07 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:08.569666 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:08.570451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:08.577932 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:08.578427 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:08.579043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:08.579701 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:08.580165 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:08.580591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:08.645748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:08.653884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-cdf207ba-2ca3-4a18-964b-51f0a11cf0fd tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1246 microversion: 2.1 time: 0.088261 Sep 23 01:42:08.654961 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 536/1069] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:08 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:09.112615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:09.113243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:09.120032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:09.120635 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:09.121095 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:09.121796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:09.122245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:09.122662 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:09.264327 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:09.273923 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a6ce12a6-0bde-4b32-8062-583a808994e3 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.165113 Sep 23 01:42:09.274740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 534/1070] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:09 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:09.677097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:09.677700 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:09.684199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:09.684679 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:09.685111 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:09.686403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:09.686855 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:09.687337 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:09.749456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:09.757214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-79db128b-d67b-485f-a564-a598a21ab4a7 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1294 microversion: 2.1 time: 0.083977 Sep 23 01:42:09.757778 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 537/1071] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:09 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:10.297608 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:10.298221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:10.305280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:10.305767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:10.306197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:10.306887 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:10.307335 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:10.307782 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:10.312461 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:10.446319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:10.459408 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4df28fc6-8108-4f05-8d5a-6c682579f40b tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.165807 Sep 23 01:42:10.460622 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 535/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:10 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:10.781241 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:10.782141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:10.789453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:10.789943 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:10.794688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:10.794688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:10.794688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:10.794688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:10.859759 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:10.869900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-709f5dbf-df22-4a40-9bc9-d48efc0a8471 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1302 microversion: 2.1 time: 0.092631 Sep 23 01:42:10.871823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 538/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:10 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:11.498090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:11.499640 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:11.506006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:11.506912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:11.507792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:11.508975 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:11.509765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:11.511349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:11.677353 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:11.686222 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9fdae88d-ab06-4c9c-b0ce-34e6ad260874 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.191437 Sep 23 01:42:11.702410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 536/1074] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:11 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:11.895534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:11.896463 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:11.902879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:11.904368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:11.904368 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:11.904630 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:11.905097 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:11.905524 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:12.135905 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:12.146357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0fd9736b-3e19-4c27-9103-32414d8d5462 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.254216 Sep 23 01:42:12.146357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 539/1075] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:11 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:12.709136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:12.714172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:12.718383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:12.718889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:12.719615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:12.720287 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a096d69-eeef-41b1-90df-2aac9412dcf7", "tag": "09bbebc7-34cd-45ad-9aa0-88895653a1ff"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:12.720615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:12.721087 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:12.721564 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:12.732017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:12.732981 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:12.733588 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:12.745922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] Creating event network-changed:09bbebc7-34cd-45ad-9aa0-88895653a1ff for instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 on hv-cinder-84914 Sep 23 01:42:12.751520 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-ac00bc53-d953-4f9e-9a9a-0c84682ed378 req-4d4f7549-e626-4318-8063-e97115156bdc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037075 Sep 23 01:42:12.752883 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 540/1076] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:12.897597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:12.906560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c7315476-fd3f-4bb1-8962-f3f78772c39a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.201356 Sep 23 01:42:12.907459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 537/1077] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:12 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:13.170619 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:13.171383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:13.178498 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:13.179085 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:13.179525 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:13.180331 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:13.180794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:13.181223 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:13.416474 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:13.426917 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2335e050-873b-4c35-a3fa-06879bc446f3 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.260969 Sep 23 01:42:13.427919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 541/1078] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:13 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:13.861845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd592cb5-a798-4609-9b39-4fd6b3e83ac0", "name": "network-vif-plugged", "status": "completed", "tag": "52a7bbe8-2f75-4994-b4db-2f20bb798cea"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:13.871901 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:13.872377 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:13.872806 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:13.887201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] Creating event network-vif-plugged:52a7bbe8-2f75-4994-b4db-2f20bb798cea for instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 on hv-cinder-84914 Sep 23 01:42:13.893550 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-7ac0ad00-a7d7-48e6-ab59-c308fd14dff7 req-89724133-bb91-4236-8417-2bbb0dbd463e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101167 Sep 23 01:42:13.896450 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 538/1079] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:42:13.930227 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:13.930931 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:13.937783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:13.938454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:13.938963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:13.939771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:13.940859 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:13.941293 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:14.093689 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:14.103640 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-a2998763-426f-4595-8c1f-fc35b6b91ec2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.177283 Sep 23 01:42:14.104188 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 542/1080] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:13 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:14.451660 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:14.452414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:14.454729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:14.459882 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:14.460363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:14.460794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:14.461518 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:14.462013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:14.462439 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:14.604384 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:14.618677 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-7d96a1f4-5b56-4356-b0b4-4bdab006d969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.171547 Sep 23 01:42:14.619291 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 539/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:14 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:15.127159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:15.127821 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:15.134842 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:15.135329 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:15.135795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:15.136494 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:15.136947 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:15.137365 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:15.277216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:15.285083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b076a91b-467e-4aa8-9d48-74d771cb7964 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1264 microversion: 2.1 time: 0.162439 Sep 23 01:42:15.285654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 543/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:15 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:15.642187 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:15.643020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:15.650239 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:15.650863 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:15.651386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:15.652211 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:15.652718 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:15.653238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:15.792740 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:15.801436 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-ddbb427f-aef5-4e0e-b6ce-23277df44ffa tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.163216 Sep 23 01:42:15.801998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 540/1083] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:15 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:16.307726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:16.308339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:16.315068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.315585 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.316028 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.316728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.317179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.317599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.471284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:16.479623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b49b2a79-7b7c-47b4-9140-b3590ddcb94d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1450 microversion: 2.1 time: 0.175887 Sep 23 01:42:16.480199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 544/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:16 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1450 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:16.502241 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:16.502847 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:16.509020 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.509498 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.511201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.511201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.511201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.511644 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.648701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:16.657854 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-580c7306-5362-4320-91fa-4ea8821b6d3d tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1450 microversion: 2.1 time: 0.159506 Sep 23 01:42:16.658423 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 541/1085] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:16 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1450 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:16.825367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:16.826017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:16.832938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.833428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.833865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.834567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:16.835036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:16.835469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:16.979482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:16.987363 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-5cb07013-2668-4921-bb26-88e4c71a8ffe tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.165995 Sep 23 01:42:16.987969 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 545/1086] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:16 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:17.786684 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a096d69-eeef-41b1-90df-2aac9412dcf7", "name": "network-vif-plugged", "status": "completed", "tag": "09bbebc7-34cd-45ad-9aa0-88895653a1ff"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:17.794692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=4 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:17.794692 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=16 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:17.800974 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:17.801483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:17.802058 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:17.814908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] Creating event network-vif-plugged:09bbebc7-34cd-45ad-9aa0-88895653a1ff for instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 on hv-cinder-84914 Sep 23 01:42:17.820543 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-baaae39c-9b4a-41a0-8376-fe21e2ec9fe7 req-e731d11c-b452-4d16-81e0-0e70e32d2220 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038405 Sep 23 01:42:17.821156 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 542/1087] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:18.012395 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:18.012998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:18.015964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=4 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:18.021481 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:18.021987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:18.023963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:18.024714 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:18.025823 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:18.026273 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:18.162509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:18.171202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9a767526-66fe-4550-acca-585e37b1773a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.162804 Sep 23 01:42:18.171812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 546/1088] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:18 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:19.095317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd592cb5-a798-4609-9b39-4fd6b3e83ac0", "tag": "52a7bbe8-2f75-4994-b4db-2f20bb798cea"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:19.106375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:19.106862 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:19.107369 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:19.120387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] Creating event network-changed:52a7bbe8-2f75-4994-b4db-2f20bb798cea for instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 on hv-cinder-84914 Sep 23 01:42:19.125968 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-f16f319c-9da9-44f0-9194-05628d637b61 req-1e21bdd9-f243-46e3-ac9c-34a8eda48723 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037486 Sep 23 01:42:19.126755 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 543/1089] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:19.194884 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:19.195685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:19.204300 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:19.204699 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:19.205130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:19.205833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:19.206285 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:19.206730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:19.374185 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:19.382847 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-430090f3-c804-422e-9c0e-46cfeda6ed78 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1368 microversion: 2.1 time: 0.192516 Sep 23 01:42:19.383793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 547/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:19 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1368 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:20.411996 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:20.412698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:20.419856 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:20.420339 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:20.420765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:20.421561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:20.422014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:20.422431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:20.563760 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:42:20.572294 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f983edc0-ad13-4cd9-a26a-769b96d97f98 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1556 microversion: 2.1 time: 0.164873 Sep 23 01:42:20.572878 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 544/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:42:20 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:42:20.603166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:20.603793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:20.610840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:20.611383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:20.611841 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:20.612527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:20.612995 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:20.613390 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:20.692114 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-57c366fa-4cbc-4ccd-b67c-9b134018589f tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093221 Sep 23 01:42:20.692710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 548/1092] 10.222.0.64 () {58 vars in 1275 bytes} [Fri Sep 23 01:42:20 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:42:21.834046 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a096d69-eeef-41b1-90df-2aac9412dcf7", "tag": "09bbebc7-34cd-45ad-9aa0-88895653a1ff"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:42:21.844700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:21.844700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:21.845174 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:21.857825 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] Creating event network-changed:09bbebc7-34cd-45ad-9aa0-88895653a1ff for instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 on hv-cinder-84914 Sep 23 01:42:21.870624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-b076725d-8306-47b0-8392-033968f025fb req-c928f43a-dd7c-489a-8dd2-9cbd1585ea5d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032943 Sep 23 01:42:21.870624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 545/1093] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:42:58.019795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:58.020564 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=84 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:42:58.024597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:42:58.025089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:42:58.031296 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:58.038001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:58.038001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:58.038001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:42:58.038001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:42:58.038440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:42:58.066071 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-b802edd3-c3e7-4937-a4f0-0273f2632b60 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/ips" status: 200 len: 148 microversion: 2.1 time: 0.047895 Sep 23 01:42:58.066718 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 549/1094] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:42:58 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:00.071243 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc94217c-6925-4dbb-9607-f12ba85bc828"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:43:00.075754 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:00.081095 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=13 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:00.082248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=48 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:00.091084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:00.092015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:00.093681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:00.094075 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:00.097624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:00.097624 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:01.202060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-8af4655a-e8b8-498b-9737-76ce84cf2328 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "POST /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139739 Sep 23 01:43:01.202917 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 546/1095] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:43:00 2022] POST /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments => generated 194 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:09.924189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:09.924771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:09.932748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:09.933237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:09.933678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:09.934379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:09.934834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:09.935262 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:10.017482 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'services' on Instance uuid 7a096d69-eeef-41b1-90df-2aac9412dcf7 {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:43:10.249084 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d797db04-644b-4a4d-b961-9faa355efb80 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments/fc94217c-6925-4dbb-9607-f12ba85bc828" status: 202 len: 0 microversion: 2.1 time: 0.328945 Sep 23 01:43:10.250182 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 550/1096] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:43:09 2022] DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments/fc94217c-6925-4dbb-9607-f12ba85bc828 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:43:10.259128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:10.267273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:10.271109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:10.277363 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:10.278514 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:10.279102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:10.280031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:10.280590 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:10.282584 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:10.313513 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-07416fda-acae-47fd-8ba8-70563b556ba1 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057237 Sep 23 01:43:10.314082 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 547/1097] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:43:10 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:11.327740 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:11.330167 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:11.337186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:11.337676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:11.338235 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:11.338945 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:11.339458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:11.339925 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:11.372974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9d7dc8e9-145e-4d9b-88d5-3c8b89928969 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050222 Sep 23 01:43:11.373599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 551/1098] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:43:11 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:12.385958 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:12.388164 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:12.394877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.395364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.395829 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:12.396528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.396984 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.397405 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:12.430273 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4749dfb7-bcea-4e6f-85d8-f8fd56655d40 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048310 Sep 23 01:43:12.430844 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 548/1099] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:43:12 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 23 01:43:12.495781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:12.496439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:12.502938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.503433 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.503964 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:12.504669 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.505128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.505591 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:12.532780 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:43:12.934801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e341acf7-9719-4a9d-9591-025d21279f73 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 204 len: 0 microversion: 2.1 time: 0.442672 Sep 23 01:43:12.935386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 552/1100] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:43:12 2022] DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:43:12.944226 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:12.944834 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:12.952802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.953390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.953862 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:12.954587 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:12.955051 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:12.955526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:13.097249 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:13.106611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-1b90cb63-c33a-4deb-b121-6a9b7ca2e41e tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1681 microversion: 2.1 time: 0.166769 Sep 23 01:43:13.107207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 549/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:12 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:43:14.130533 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:14.131222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:14.137829 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:14.138316 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:14.138743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:14.139443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:14.139911 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:14.140334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:14.278839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:14.288512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-918ba6ff-cda7-4f6d-aca7-bf89a5ee5301 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1681 microversion: 2.1 time: 0.162863 Sep 23 01:43:14.289079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 553/1102] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:14 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:43:15.312802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:15.314799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:15.333381 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:15.333884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:15.334440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:15.335048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:15.335521 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:15.340368 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:15.410937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:15.419410 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-060d74e7-727b-4962-b667-4caad14655ed tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1613 microversion: 2.1 time: 0.110484 Sep 23 01:43:15.420072 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 550/1103] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:15 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:43:15.638434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a096d69-eeef-41b1-90df-2aac9412dcf7", "name": "network-vif-deleted", "tag": "09bbebc7-34cd-45ad-9aa0-88895653a1ff"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:43:15.649800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:15.650290 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:15.650725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:15.663801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] Creating event network-vif-deleted:09bbebc7-34cd-45ad-9aa0-88895653a1ff for instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 on hv-cinder-84914 Sep 23 01:43:15.669046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-e73d0071-8154-4155-a9b8-59e92af9519e req-a1d66e42-f0fe-4a8c-bbd9-36c01713ddab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034497 Sep 23 01:43:15.670240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 554/1104] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:16.447766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:16.449165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:16.469251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:16.470173 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:16.471305 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:16.472750 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:16.473687 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:16.474390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:16.538251 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:16.539276 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:16.540008 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:16.540864 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lazy-loading 'fault' on Instance uuid 7a096d69-eeef-41b1-90df-2aac9412dcf7 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:43:16.593742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ce3e8c1e4f84274a1f5edb940ea4454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15460898c2b4b15bfee3d39a01273b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:16.604715 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-bc1c32cb-8848-4ac6-a4a4-30e1c57f3ecb tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 200 len: 1332 microversion: 2.1 time: 0.164930 Sep 23 01:43:16.605391 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 551/1105] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:16 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 1332 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:43:17.630170 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:17.630771 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:17.637256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:17.637754 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:17.638189 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:17.639072 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:17.639346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:17.639806 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:17.654245 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 HTTP/1.1 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:17.655956 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:17.658297 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '7a096d69-eeef-41b1-90df-2aac9412dcf7'} Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:17.660135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:17.661836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:17.663205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:17.663205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-6f8bda92-6a18-4fda-ae17-3550d83e984a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 404 len: 111 microversion: 2.1 time: 0.032181 Sep 23 01:43:17.663205 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 555/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:17 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:17.668676 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-30429055-c464-45c5-ab9b-9f3031a46bb0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '.version_select at 0x7f767904c4c0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:17.753670 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-30429055-c464-45c5-ab9b-9f3031a46bb0 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433064652" status: 202 len: 0 microversion: 2.1 time: 0.088866 Sep 23 01:43:17.754300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 552/1107] 10.222.0.64 () {58 vars in 1221 bytes} [Fri Sep 23 01:43:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1433064652 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:43:20.060211 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:20.061148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:20.069447 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:20.069950 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:20.070392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:20.071119 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:20.071634 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:20.072054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:20.087863 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 HTTP/1.1 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:20.089456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.091952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '7a096d69-eeef-41b1-90df-2aac9412dcf7'} Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:20.093247 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.095058 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.096983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:20.096983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-09dde8fd-a075-414f-8875-39c32b173da5 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 404 len: 111 microversion: 2.1 time: 0.035005 Sep 23 01:43:20.096983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 556/1108] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:43:20 2022] DELETE /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:20.106115 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:20.107143 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7a096d69-eeef-41b1-90df-2aac9412dcf7] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:20.119059 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:20.119978 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:20.120894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:20.122021 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:20.122804 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:20.123615 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:20.143102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 HTTP/1.1 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:43:20.144877 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.147526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '7a096d69-eeef-41b1-90df-2aac9412dcf7'} Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:20.148998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. Sep 23 01:43:20.151611 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:20.154088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7a096d69-eeef-41b1-90df-2aac9412dcf7 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:20.154088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6944cb15-5ac7-483b-8042-808403181396 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7" status: 404 len: 111 microversion: 2.1 time: 0.047940 Sep 23 01:43:20.154088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 553/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:20 2022] GET /compute/v2.1/servers/7a096d69-eeef-41b1-90df-2aac9412dcf7 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:21.511444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:21.512184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:21.519892 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.520383 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.520818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.521537 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.521987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.522408 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.537576 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 HTTP/1.1 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:21.539147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.541809 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '7140fb1a-d0fd-4874-8777-ec98b34bae21'} Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:21.543314 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.545742 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.548599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:21.548599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-addf2eb6-0271-41ae-a01b-3585db947314 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 404 len: 111 microversion: 2.1 time: 0.033328 Sep 23 01:43:21.548599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 557/1110] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:43:21 2022] DELETE /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:21.553218 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:21.553892 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 7140fb1a-d0fd-4874-8777-ec98b34bae21] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:21.561345 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.561827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.562261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.562967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.563421 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.563913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.579701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 HTTP/1.1 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:43:21.581322 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.589759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '7140fb1a-d0fd-4874-8777-ec98b34bae21'} Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:21.590679 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. Sep 23 01:43:21.592205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.593618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 7140fb1a-d0fd-4874-8777-ec98b34bae21 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:21.593618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d09a7846-d6cc-458f-8832-b20bc8311dcc tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21" status: 404 len: 111 microversion: 2.1 time: 0.035034 Sep 23 01:43:21.593618 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 554/1111] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:21 2022] GET /compute/v2.1/servers/7140fb1a-d0fd-4874-8777-ec98b34bae21 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:43:21.596452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:21.597150 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:21.611162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.611677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.612112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.613583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.614051 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.614593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.632152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 HTTP/1.1 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:21.633965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.635618 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '38f798dc-4e0c-4d00-aaf1-981c818467d3'} Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:21.636542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.638140 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.639676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:21.639676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-024ec3b9-5ecb-48ee-8a9b-d4464756d140 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 404 len: 111 microversion: 2.1 time: 0.044469 Sep 23 01:43:21.639676 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 558/1112] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:43:21 2022] DELETE /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:21.645316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:21.645918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: 38f798dc-4e0c-4d00-aaf1-981c818467d3] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:21.652364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.652861 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.653293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.654003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:21.654525 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:21.654953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:21.669900 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 HTTP/1.1 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:43:21.671476 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.673985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': '38f798dc-4e0c-4d00-aaf1-981c818467d3'} Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:21.676259 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. Sep 23 01:43:21.678922 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:21.681037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance 38f798dc-4e0c-4d00-aaf1-981c818467d3 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:21.681037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6b8f00f0-60c4-41aa-b150-04a4afe74236 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3" status: 404 len: 111 microversion: 2.1 time: 0.031580 Sep 23 01:43:21.681037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 555/1113] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:21 2022] GET /compute/v2.1/servers/38f798dc-4e0c-4d00-aaf1-981c818467d3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:23.073274 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:23.073848 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:23.080044 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:23.080523 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:23.080955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:23.081664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:23.082108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:23.082531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:23.096833 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d HTTP/1.1 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:23.098402 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.100311 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'b9aa9456-2386-4774-acb6-bce201e6d94d'} Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:23.101391 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.102942 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.104654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:23.104654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-39b680c0-8160-47fb-8a4f-203c15e1df8a tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 404 len: 111 microversion: 2.1 time: 0.030397 Sep 23 01:43:23.104654 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 559/1114] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:43:23 2022] DELETE /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:23.108770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:23.109374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] [instance: b9aa9456-2386-4774-acb6-bce201e6d94d] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:23.116658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:23.117190 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:23.117566 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:23.118265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:23.118704 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:23.119149 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:23.134221 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] HTTP exception thrown: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Request method failure captured: Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d HTTP/1.1 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4Sggd8DOnW0Gul8OxYgIZ8MJbEkgB3q7sT_V0qa5z_IxZGe4obHbzZHanqDvTKJL-ZbESUTwIApMNCjU45Hupc6a2DPnaQXKcbTKMQjozIGt4NzbZps2sIK_oyCvntVvb-RYQ2AMX3QAVFcOKrrMW_891cNf78Yw4YkLK1TUmOjQE Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:43:23.135918 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a15460898c2b4b15bfee3d39a01273b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a15460898c2b4b15bfee3d39a01273b4", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: a15460898c2b4b15bfee3d39a01273b4 Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547361320 Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 3ce3e8c1e4f84274a1f5edb940ea4454 Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-AttachVolumeNegativeTest-1547361320-project Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.137749 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'b9aa9456-2386-4774-acb6-bce201e6d94d'} Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:23.138558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. Sep 23 01:43:23.139831 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:43:23.141124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] Returning 404 to user: Instance b9aa9456-2386-4774-acb6-bce201e6d94d could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:23.141124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3241939f-b891-4bc4-be86-cf1d24ab4a00 tempest-AttachVolumeNegativeTest-1547361320 tempest-AttachVolumeNegativeTest-1547361320-project] 10.222.0.64 "GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d" status: 404 len: 111 microversion: 2.1 time: 0.032452 Sep 23 01:43:23.141124 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 556/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:23 2022] GET /compute/v2.1/servers/b9aa9456-2386-4774-acb6-bce201e6d94d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:29.101443 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-129acef1-1aee-4171-8c72-23ee716756d2 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Action: 'create', calling method: .version_select at 0x7f76792afdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-537893284", "metadata": {"Type": "work"}}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:43:29.879008 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-129acef1-1aee-4171-8c72-23ee716756d2 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.897181 Sep 23 01:43:29.879623 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 560/1116] 10.222.0.64 () {60 vars in 1156 bytes} [Fri Sep 23 01:43:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 899 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 23 01:43:29.892627 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-fd16b3ab-f61e-442b-859a-03b065c145ea tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f76790b91f0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:29.941689 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-fd16b3ab-f61e-442b-859a-03b065c145ea tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 200 len: 352 microversion: 2.1 time: 0.052779 Sep 23 01:43:29.942238 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 557/1117] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:43:29 2022] GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:30.958086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ddbcc277-4e16-4903-be6d-5589ee7effba tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f76791aa1f0>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:31.007541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ddbcc277-4e16-4903-be6d-5589ee7effba tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 200 len: 353 microversion: 2.1 time: 0.055722 Sep 23 01:43:31.008198 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 561/1118] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:43:30 2022] GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:31.021635 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-639f8aea-f67b-4b76-9294-7254bbf08e7a tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f7678fab700>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:31.070209 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-639f8aea-f67b-4b76-9294-7254bbf08e7a tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 200 len: 353 microversion: 2.1 time: 0.052917 Sep 23 01:43:31.070778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 558/1119] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:43:31 2022] GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:43:31.088728 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8673a247-a8f4-43a4-9a0c-d5665737be88 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f7679166670>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:31.269660 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8673a247-a8f4-43a4-9a0c-d5665737be88 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 202 len: 0 microversion: 2.1 time: 0.184815 Sep 23 01:43:31.272976 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 562/1120] 10.222.0.64 () {58 vars in 1248 bytes} [Fri Sep 23 01:43:31 2022] DELETE /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:43:31.278907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-992313ba-f5d3-403a-b5e9-af6a8869f803 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f7678f5f0d0>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:31.329796 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-992313ba-f5d3-403a-b5e9-af6a8869f803 tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 200 len: 352 microversion: 2.1 time: 0.054566 Sep 23 01:43:31.330612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 559/1121] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:43:31 2022] GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:43:32.345490 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3a5ab627-b759-48d1-b6fe-bcf9f593c80e tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Calling method '.version_select at 0x7f76794f3820>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:32.375295 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-3a5ab627-b759-48d1-b6fe-bcf9f593c80e tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] HTTP exception thrown: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3a5ab627-b759-48d1-b6fe-bcf9f593c80e tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Request method failure captured: Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 HTTP/1.1 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ9AYDGuJG4wtM6tNwq5x-Oq1QvMPFA8x9VM3Zrfqio9Zlek1nHcYeRriVMFc5VnH0YTc_sAs_g2la2Qqv6h-2FWiq0dhT95E89UAxn0KTxvd2IIPJP12XJRVLUDIQ6NyJuvcxDu_jBuoq4RjTkjlrLz4IedVvEtpeYk5pGJhbMWPxc Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: ff9961b5ad944a09bf66715de7c32e95 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-VolumesGetTestJSON-1849192247 Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:43:32.377373 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff9961b5ad944a09bf66715de7c32e95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ff9961b5ad944a09bf66715de7c32e95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ff9961b5ad944a09bf66715de7c32e95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ff9961b5ad944a09bf66715de7c32e95", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-VolumesGetTestJSON-1849192247 Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: ff9961b5ad944a09bf66715de7c32e95 Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-VolumesGetTestJSON-1849192247 Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-VolumesGetTestJSON-1849192247-project Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: c6698f091c9b4bda859b7bda9e83d4cb Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-VolumesGetTestJSON-1849192247-project Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'fc293e59-4d4a-4e45-a364-126f730da8c6'} Sep 23 01:43:32.379001 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. (HTTP 404) (Request-ID: req-a323758d-266b-450b-b14a-723ade5895e5) Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:32.380163 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 23 01:43:32.381674 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 23 01:43:32.383130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3a5ab627-b759-48d1-b6fe-bcf9f593c80e tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] Returning 404 to user: Volume fc293e59-4d4a-4e45-a364-126f730da8c6 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3a5ab627-b759-48d1-b6fe-bcf9f593c80e tempest-VolumesGetTestJSON-1849192247 tempest-VolumesGetTestJSON-1849192247-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6" status: 404 len: 109 microversion: 2.1 time: 0.037673 Sep 23 01:43:32.384786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 563/1122] 10.222.0.64 () {58 vars in 1245 bytes} [Fri Sep 23 01:43:32 2022] GET /compute/v2.1/os-volumes/fc293e59-4d4a-4e45-a364-126f730da8c6 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:43:57.190617 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:57.191359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:57.197096 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66775868", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-277631498", "security_groups": [{"name": "tempest-secgroup-smoke-309655662"}], "block_device_mapping_v2": [{"uuid": "e911e81b-3c03-4949-8d28-ca615c846152", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7fe1919f-1f3e-419a-91a3-220386faadcd"}]}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:43:57.316180 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.network.neutron [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] validate_networks() for [('7fe1919f-1f3e-419a-91a3-220386faadcd', None, None, None, None, None)] {{(pid=121762) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:43:57.703197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:43:57.703658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image limits 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:43:57.704122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Flavor pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:43:57.704520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Image pref 0:0:0 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:43:57.704970 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.virt.hardware [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121762) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:43:57.714272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:57.714924 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:57.715386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:57.716150 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:57.716608 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:57.717027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:57.734361 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:43:57.738626 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Getting quotas for user ad7c407cfe924b7a8652f8387c7f77b4 and project f5c5ef59b1b44d8a916be97d8d11493f. Resources: {'instances', 'cores', 'ram'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:43:57.798389 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Going to run 1 instances... {{(pid=121762) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:43:57.800633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e911e81b-3c03-4949-8d28-ca615c846152',volume_size=None,volume_type=None)] {{(pid=121762) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:43:58.267575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9791572d-5c13-4032-9d05-15e15dd5f790 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.078140 Sep 23 01:43:58.268396 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 560/1123] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:43:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:43:58.276861 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:58.277624 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:43:58.280088 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:43:58.280234 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Fri Sep 23 01:43:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b (ip 10.222.0.64) !!! Sep 23 01:43:58.284736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9a170604-7ed9-42dc-b0d7-56832b278f82 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:58.285338 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9a170604-7ed9-42dc-b0d7-56832b278f82 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:58.340099 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9a170604-7ed9-42dc-b0d7-56832b278f82 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:58.347261 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9a170604-7ed9-42dc-b0d7-56832b278f82 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1092 microversion: 2.1 time: 0.071207 Sep 23 01:43:58.347869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 564/1124] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:58 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1092 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:43:59.371999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:43:59.372594 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:43:59.379529 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:59.380048 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:59.380503 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:59.381179 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:43:59.381638 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:43:59.382061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:43:59.447284 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:43:59.458193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d9db3510-dbe5-491e-b2dd-71ed421c2446 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1142 microversion: 2.1 time: 0.091109 Sep 23 01:43:59.458788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 561/1125] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:43:59 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1142 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:00.481834 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:00.482451 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:00.490647 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:00.491136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:00.491587 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:00.492278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:00.493231 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:00.493652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:00.559508 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:00.567702 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-635defe8-39da-43e7-a3a0-f44f0cb5f10c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1142 microversion: 2.1 time: 0.090036 Sep 23 01:44:00.568284 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 565/1126] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:00 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1142 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:01.713921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:01.714681 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:01.720755 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:01.725828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:01.725828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:01.725828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:01.725828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:01.726207 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:01.788762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:01.797475 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0fb565aa-b3e6-4d64-b7b5-d7c2fb6f0d54 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1190 microversion: 2.1 time: 0.209229 Sep 23 01:44:01.798569 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 562/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:01 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1190 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:02.822387 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:02.822996 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:02.830868 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:02.831376 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:02.831966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:02.832662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:02.833112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:02.833534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:02.904912 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:02.913358 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3ec8c2fa-224c-4274-8894-85c81a9d4ba2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1208 microversion: 2.1 time: 0.094766 Sep 23 01:44:02.913992 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 566/1128] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:02 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1208 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:44:03.938054 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:03.938657 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:03.946383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:03.946868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:03.947293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:03.948003 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:03.948453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:03.948956 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:03.979412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f0791b-92aa-41df-997a-240cb2eeb40b", "tag": "c9c7a5b9-4b97-4534-8781-dafaa5dc00df"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:44:03.991108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:03.991706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:03.992360 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:04.004812 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] Creating event network-changed:c9c7a5b9-4b97-4534-8781-dafaa5dc00df for instance 42f0791b-92aa-41df-997a-240cb2eeb40b on hv-cinder-84914 Sep 23 01:44:04.010876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-0f40b8d4-2a3e-4c95-a52e-3d2c3e7d5d7a req-837d02dd-5645-40ec-924d-b8794ff87533 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035383 Sep 23 01:44:04.011601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 567/1129] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:44:04.095296 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:04.103773 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9e527c5b-3aeb-4810-8ee8-0d27025bd7be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1275 microversion: 2.1 time: 0.169495 Sep 23 01:44:04.108865 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 563/1130] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:03 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1275 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:05.128516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:05.129212 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:05.135580 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:05.136068 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:05.136496 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:05.137190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:05.137638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:05.138049 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:05.276661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:05.284499 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-eb181479-2cfa-4db3-bc58-c9d514401e10 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.160812 Sep 23 01:44:05.284975 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 568/1131] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:05 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:06.308982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:06.310014 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:06.317536 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:06.317921 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:06.318372 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:06.319090 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:06.319571 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:06.320154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:06.475019 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:06.483737 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d5f42188-22a5-426d-8be7-21a898f605be tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.180110 Sep 23 01:44:06.484337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 564/1132] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:06 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:07.507473 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:07.508923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:07.515530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:07.516093 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:07.516526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:07.517220 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:07.517670 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:07.518086 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:07.656048 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:07.663944 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ccd3ab23-fef0-4bfa-bb38-ee3b16936e58 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.160343 Sep 23 01:44:07.665017 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 569/1133] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:07 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:08.688504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:08.689067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:08.691311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:44:08.692004 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=6 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:44:08.697023 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:08.697507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:08.697981 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:08.698685 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:08.699136 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:08.699580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:08.841648 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:08.849505 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f29539d4-c827-4827-8156-440a9496feef tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.164969 Sep 23 01:44:08.850868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 565/1134] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:08 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:09.873675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:09.877428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:09.877428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:44:09.882168 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:09.882662 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:09.883112 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:09.883839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:09.884328 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:09.884776 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:10.021705 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:10.029854 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-bb4d1d15-888e-4457-882a-dcbd590967a5 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.160640 Sep 23 01:44:10.030423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 570/1135] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:09 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:11.053341 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:11.053982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:11.061062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:11.061547 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:11.061982 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:11.062678 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:11.063134 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:11.063575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:11.201017 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:11.208999 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-afc20b6c-c653-47e1-a700-25ff68a2c18e tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.159527 Sep 23 01:44:11.209575 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 566/1136] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:11 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:12.231527 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:12.232310 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:12.239006 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:12.239470 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:12.239938 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:12.240629 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:12.241080 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:12.241500 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:12.379837 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:12.390199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-8ae5f29c-a4a1-4234-ba1e-099cc3066abc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.162539 Sep 23 01:44:12.391043 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 571/1137] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:12 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:13.413766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:13.414493 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:13.421818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:13.422374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:13.422732 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:13.423431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:13.423914 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:13.424332 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:13.582217 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:13.590851 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-74be082d-3496-4613-bce0-3b03105a0e84 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.181206 Sep 23 01:44:13.591426 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 567/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:13 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:14.613793 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:14.614516 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:14.621566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:14.622057 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:14.622493 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:14.623192 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:14.623673 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:14.624105 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:14.780794 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:14.789860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1e6666bd-8f7b-41f6-bf15-9fc687d646fa tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.179898 Sep 23 01:44:14.790439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 572/1139] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:14 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:15.824300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:15.824947 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:15.840382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:15.840871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:15.841308 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:15.842013 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:15.842470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:15.842899 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:15.979089 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:15.987348 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-82161dec-bb5e-481a-9280-f874aca3147c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.177855 Sep 23 01:44:15.987953 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 568/1140] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:15 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:17.011758 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:17.012397 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:17.018965 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:17.019444 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:17.020010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:17.020703 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:17.021154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:17.021577 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:17.161910 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:17.170325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-58ade3f6-775a-4a0e-8e66-057cf2da0f16 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.163378 Sep 23 01:44:17.170913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 573/1141] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:17 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:18.193196 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:18.193803 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:18.202199 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:18.202904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:18.203422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:18.204745 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:18.204944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:18.205520 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:18.344256 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:18.352414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-85d4dd05-7332-437f-94cc-593f01adc6f7 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.163271 Sep 23 01:44:18.352990 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 569/1142] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:18 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:44:18.403815 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f0791b-92aa-41df-997a-240cb2eeb40b", "name": "network-vif-plugged", "status": "completed", "tag": "c9c7a5b9-4b97-4534-8781-dafaa5dc00df"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:44:18.414731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:18.415218 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:18.415684 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:18.426919 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] Creating event network-vif-plugged:c9c7a5b9-4b97-4534-8781-dafaa5dc00df for instance 42f0791b-92aa-41df-997a-240cb2eeb40b on hv-cinder-84914 Sep 23 01:44:18.432251 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-9aa95b5c-3752-4765-a180-6d115c85d58f req-5f68099b-64fc-4363-b11f-3bfc50593779 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032397 Sep 23 01:44:18.432922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 574/1143] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:44:19.375505 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:19.376203 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:19.382955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:19.383440 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:19.383926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:19.384630 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:19.385108 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:19.385531 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:19.539205 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:19.548386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b4ec564f-1559-4527-9821-7a226442094a tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1263 microversion: 2.1 time: 0.176835 Sep 23 01:44:19.549360 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 570/1144] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:19 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:20.574184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:20.574885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:20.582233 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:20.582783 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:20.583222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:20.583952 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:20.584414 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:20.584839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:20.725268 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:20.735426 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f2b6aae5-0946-47da-a7dc-cfbca4ae4691 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1450 microversion: 2.1 time: 0.165587 Sep 23 01:44:20.736054 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 575/1145] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:20 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1450 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:20.770344 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:44:20.770963 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:44:20.777625 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:20.778042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:20.778474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:20.779691 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:20.780146 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:20.780572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:20.920252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:44:20.928030 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6168658d-c68f-42e3-8f7a-c5c5a4b6cd35 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1450 microversion: 2.1 time: 0.161487 Sep 23 01:44:20.928605 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 571/1146] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:44:20 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:44:23.096678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f0791b-92aa-41df-997a-240cb2eeb40b", "tag": "c9c7a5b9-4b97-4534-8781-dafaa5dc00df"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:44:23.106828 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:44:23.107940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:44:23.108439 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:44:23.122378 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] Creating event network-changed:c9c7a5b9-4b97-4534-8781-dafaa5dc00df for instance 42f0791b-92aa-41df-997a-240cb2eeb40b on hv-cinder-84914 Sep 23 01:44:23.128246 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-b5352509-5986-49e8-88e2-8a222e342b11 req-64b3f78d-588c-48ca-9f71-e7097dc25ae4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035380 Sep 23 01:44:23.129202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 576/1147] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:45:43.906607 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:43.907364 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=68 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:43.908641 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 23 01:45:43.909340 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Fri Sep 23 01:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Sep 23 01:45:43.910623 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:45:43.910786 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Fri Sep 23 01:45:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.64) !!! Sep 23 01:45:43.914791 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-71fbe2c2-6c5a-406d-b5ff-750d8d4cc94e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'create', calling method: .version_select at 0x7f7678fdc280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1137466195", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO84ylYzsUXJ+OKhyCjMoX0nvDOrrvaSUrdwxxMXvErR5p9iAzC66ZTfUmSa617Pk1pYbsA8Tj2xbOJuq39LD1CFddmPHVv1KlHB+9Gf26Aw5YYBSzONyKHXKcj+y4WWqw=="}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:45:43.936248 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-71fbe2c2-6c5a-406d-b5ff-750d8d4cc94e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Getting quotas for project 403b0f1ad71c459581759568e4fcd1ca. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:45:43.939997 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.quota [None req-71fbe2c2-6c5a-406d-b5ff-750d8d4cc94e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Getting quotas for user 0857c0af9c944a2fb6e75c7297945fc0 and project 403b0f1ad71c459581759568e4fcd1ca. Resources: {'key_pairs'} {{(pid=121762) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:45:44.078930 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-71fbe2c2-6c5a-406d-b5ff-750d8d4cc94e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.174284 Sep 23 01:45:44.079534 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 572/1148] 10.222.0.64 () {60 vars in 1159 bytes} [Fri Sep 23 01:45:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:45:44.134599 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=28 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:44.135668 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=60 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:44.140991 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-194570555", "imageRef": "c9e0ffa9-ffee-4e46-952e-9f8959f7b648", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1137466195", "networks": [{"uuid": "cfa5ae8e-5309-40a3-bdd3-f79101f55f6d"}]}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:45:44.336940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.network.neutron [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] validate_networks() for [('cfa5ae8e-5309-40a3-bdd3-f79101f55f6d', None, None, None, None, None)] {{(pid=121763) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 23 01:45:44.837062 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Flavor limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 23 01:45:44.837486 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Image limits 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 23 01:45:44.837957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Flavor pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 23 01:45:44.838366 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Image pref 0:0:0 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 23 01:45:44.838786 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.virt.hardware [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121763) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 23 01:45:44.847876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:44.848357 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:44.848790 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:44.849546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:44.850003 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:44.850428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:44.867731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Getting quotas for project 403b0f1ad71c459581759568e4fcd1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 23 01:45:44.872125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.quota [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Getting quotas for user 0857c0af9c944a2fb6e75c7297945fc0 and project 403b0f1ad71c459581759568e4fcd1ca. Resources: {'instances', 'cores', 'ram'} {{(pid=121763) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 23 01:45:44.884144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Going to run 1 instances... {{(pid=121763) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 23 01:45:44.886487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c9e0ffa9-ffee-4e46-952e-9f8959f7b648',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121763) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 23 01:45:45.033460 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ab33dd54-574f-48fc-b5ee-5235b23e7d3d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901154 Sep 23 01:45:45.034736 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 577/1149] 10.222.0.64 () {60 vars in 1147 bytes} [Fri Sep 23 01:45:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 23 01:45:45.046561 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-acc79b8c-9d9f-44ca-9be9-9c4ab423abbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:45.047178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-acc79b8c-9d9f-44ca-9be9-9c4ab423abbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:45.158062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-acc79b8c-9d9f-44ca-9be9-9c4ab423abbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:45.165272 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-acc79b8c-9d9f-44ca-9be9-9c4ab423abbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1258 microversion: 2.1 time: 0.123791 Sep 23 01:45:45.165969 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 573/1150] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:45 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1258 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:46.190978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e037a37c-7533-4810-a484-02d0587c48ab tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:46.191651 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e037a37c-7533-4810-a484-02d0587c48ab tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:46.245326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e037a37c-7533-4810-a484-02d0587c48ab tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:46.253935 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e037a37c-7533-4810-a484-02d0587c48ab tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1258 microversion: 2.1 time: 0.067317 Sep 23 01:45:46.254374 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 578/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:46 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:47.277746 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:47.278464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:47.285160 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:47.285651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:47.286100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:47.286788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:47.287244 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:47.287712 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:47.355287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:47.363813 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-b6deb5ad-ae9e-4ef4-9d41-4e41b6468250 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1310 microversion: 2.1 time: 0.089989 Sep 23 01:45:47.364398 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 574/1152] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:47 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:45:48.387260 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:48.388015 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:48.395663 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:48.396207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:48.396649 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:48.397346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:48.397816 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:48.398226 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:48.608442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:48.623726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-ebe4d94b-44fe-4393-97d0-e47770e9d1b9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.240190 Sep 23 01:45:48.628853 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 579/1153] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:48 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:49.652201 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:49.653797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:49.661633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:49.662482 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:49.663219 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:49.664301 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:49.665176 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:49.665884 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:49.835320 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:49.843934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-014dc7ce-52b5-40ba-85b8-5c582b09796e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.196553 Sep 23 01:45:49.856197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 575/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:49 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:50.873299 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:50.874428 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:50.885256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:50.886152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:50.886987 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:50.888566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:50.889304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:50.890064 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:51.032643 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:51.041390 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-559e0c07-98f3-4daa-936d-b94c8a224c4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.175524 Sep 23 01:45:51.043593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 580/1155] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:50 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:45:52.065512 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:52.066132 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:52.073210 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:52.073706 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:52.076184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:52.077007 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:52.077553 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:52.078061 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:52.220579 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:52.229639 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9de62d08-c677-4f96-aec8-3cb314124356 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.168686 Sep 23 01:45:52.239650 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 576/1156] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:52 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:53.255704 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:53.257222 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:53.265184 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:53.266656 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:53.267840 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:53.269442 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:53.270369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:53.271420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:53.463239 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:53.473597 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-03293f01-2b69-4067-89e3-7dfa48b5ff5c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.222986 Sep 23 01:45:53.474768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 581/1157] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:53 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:53.804955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:53.805526 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:53.815351 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42f0791b-92aa-41df-997a-240cb2eeb40b", "tag": "c9c7a5b9-4b97-4534-8781-dafaa5dc00df"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:45:53.827873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:53.827873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:53.827873 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:53.833927 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:53.834300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:53.834948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:53.835871 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:53.836499 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:53.837088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:53.847069 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] Creating event network-changed:c9c7a5b9-4b97-4534-8781-dafaa5dc00df for instance 42f0791b-92aa-41df-997a-240cb2eeb40b on hv-cinder-84914 Sep 23 01:45:53.853354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-f71cffb7-a4c3-4445-b05d-3eb9523d4435 req-06954fd6-6e98-45f1-9e83-7b087156a05b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044130 Sep 23 01:45:53.854296 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 582/1158] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:45:53.880414 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Going to try to terminate instance {{(pid=121762) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:45:54.271808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-315926a7-f061-4931-a8f3-800407e114f2 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 204 len: 0 microversion: 2.1 time: 0.470649 Sep 23 01:45:54.276139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 577/1159] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:45:53 2022] DELETE /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:45:54.282325 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:54.283031 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:54.290186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:54.290673 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:54.291132 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:54.292082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:54.292541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:54.292966 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:54.470869 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:54.479710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-2c858187-3501-41f9-a34b-d42a2f511f83 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1574 microversion: 2.1 time: 0.201837 Sep 23 01:45:54.480289 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 583/1160] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:54 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1574 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:54.509792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:54.510604 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:54.517042 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:54.517646 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:54.518637 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:54.518979 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:54.519649 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:54.520183 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:54.712309 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:54.720727 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-4401f833-46f1-47ff-b762-7ccfe856a32e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.215187 Sep 23 01:45:54.721350 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 578/1161] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:54 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:55.508825 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:55.510181 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:55.512458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=2 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:55.519036 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:55.519515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:55.519988 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:55.520726 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:55.521213 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:55.521672 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:55.675039 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:55.681340 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-359a53df-477a-4664-a98e-6506e4386a78 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1574 microversion: 2.1 time: 0.176407 Sep 23 01:45:55.681955 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 584/1162] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:55 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:55.793881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:55.793881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:55.793881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=6 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:55.793881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:55.793881 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:55.794948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:55.794948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:55.794948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:55.794948 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:55.911258 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:55.920045 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-82a123e8-9b2c-4b6e-b662-5460eb490983 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.179788 Sep 23 01:45:55.920589 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 579/1163] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:55 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:56.705288 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:56.705889 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:56.708844 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell0:SELECT=8 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:45:56.713052 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:56.713546 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:56.713974 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:56.714677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:56.715130 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:56.715583 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:56.914225 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:56.922278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-670a73fa-6aa9-479e-9bb8-2f360c8bccf1 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1574 microversion: 2.1 time: 0.221031 Sep 23 01:45:56.922875 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 585/1164] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:56 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1574 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:56.945192 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:56.945824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:56.952889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:56.953375 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:56.953808 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:56.954506 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:56.954957 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:56.955967 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:57.097568 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:57.107374 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e54055a0-0836-46e0-90c1-0ee573bc54ac tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.165987 Sep 23 01:45:57.107994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 580/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:56 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:57.476110 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:45:57.486454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:57.487453 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:57.487922 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:57.498915 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] Creating event network-changed:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:45:57.504836 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-d8c1d157-0fbc-4803-b2cc-78080aaace56 req-24149294-81da-4322-be67-b48601885b96 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095178 Sep 23 01:45:57.505491 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 586/1166] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:45:57.945742 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:57.946366 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:57.952720 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:57.953200 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:57.953633 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:57.954347 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:57.954797 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:57.955214 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:58.127535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:58.131819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:58.132354 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:58.136242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-969a2135-2fd8-4c02-8764-8fb67af38429 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1574 microversion: 2.1 time: 0.194356 Sep 23 01:45:58.137193 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 581/1167] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:57 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:58.138509 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:58.138963 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:58.139401 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:58.140123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:58.141146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:58.141146 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:58.272787 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:58.280578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-859e927c-7dd8-494f-a3ec-89b4df288f6f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.154021 Sep 23 01:45:58.281143 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 587/1168] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:58 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:45:59.159317 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:59.160050 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:59.166818 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:59.167293 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:59.167757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:59.168448 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:59.168889 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:59.169300 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:59.236560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:59.244570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e75a1ce8-4dde-4dcf-b0d1-6e9e2398d8f0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1389 microversion: 2.1 time: 0.089562 Sep 23 01:45:59.245064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 582/1169] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:59 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1389 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:59.304208 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:45:59.304768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:45:59.311953 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:59.312559 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:59.313024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:59.313799 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:59.314294 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:59.314720 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:59.460328 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:45:59.468420 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-960ee3ed-a50f-49c4-9b1f-cb7df950014c tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.168111 Sep 23 01:45:59.468862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 588/1170] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:45:59 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:45:59.519736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42f0791b-92aa-41df-997a-240cb2eeb40b", "name": "network-vif-deleted", "tag": "c9c7a5b9-4b97-4534-8781-dafaa5dc00df"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:45:59.529290 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:45:59.529759 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:45:59.530161 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:45:59.541024 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] Creating event network-vif-deleted:c9c7a5b9-4b97-4534-8781-dafaa5dc00df for instance 42f0791b-92aa-41df-997a-240cb2eeb40b on hv-cinder-84914 Sep 23 01:45:59.547472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-e8526d7d-3764-4e0e-aba2-8d46e6c0341e req-a0aad72c-d459-4ac8-ae09-7d0d4dc7a9d5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030851 Sep 23 01:45:59.547472 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 583/1171] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:00.267172 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:00.267800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:00.273801 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:00.274392 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:00.274819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:00.275507 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:00.275979 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:00.276404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:00.341330 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:00.349882 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-3c5ab803-8457-45e0-8466-54ce9c9e5d93 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1223 microversion: 2.1 time: 0.086586 Sep 23 01:46:00.350475 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 589/1172] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:00 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:00.491337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:00.492071 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:00.498247 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:00.498762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:00.499159 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:00.499875 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:00.500319 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:00.500734 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:00.632646 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:00.640431 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-3647a178-001d-44ab-8102-a94c7aecbf53 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.153804 Sep 23 01:46:00.641185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 584/1173] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:00 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:01.374408 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:01.375023 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:01.381818 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:01.382320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:01.382764 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:01.383532 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:01.384135 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:01.384578 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:01.417504 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:01.419483 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:01.419994 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:01.420555 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lazy-loading 'fault' on Instance uuid 42f0791b-92aa-41df-997a-240cb2eeb40b {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:46:01.462059 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:01.469957 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-efb04d8d-f118-49f5-b1c5-fa5800da100c tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 200 len: 1228 microversion: 2.1 time: 0.099407 Sep 23 01:46:01.470526 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 590/1174] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:01 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 1228 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:01.664330 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:01.664894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:01.672651 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:01.673131 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:01.673560 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:01.674254 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:01.674701 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:01.675799 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:01.814177 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:01.823386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e2390fd5-5ee1-4283-9de6-67c84ad82609 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.162894 Sep 23 01:46:01.831845 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 585/1175] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:01 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:02.493983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:02.494648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: 42f0791b-92aa-41df-997a-240cb2eeb40b] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:02.501129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:02.501622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:02.502061 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:02.502808 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:02.503273 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:02.503730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:02.517746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] HTTP exception thrown: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Request method failure captured: Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b HTTP/1.1 Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4teQjXQY_Cjs76AnXKIqf_hPudbm4xQwxm-rdFrdBczb4Kfk30vMs9ANIrT0_tdDUsByOg_eT8a54aKcWZUELiazuZv5ggVRdGO6fmiTfSBCg9-3Unhvzs3l5lVvILgJe43nQsxOeiLuJ5aZHuMoN68n0gh-svQyvwnQRBT7GJank Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:46:02.519413 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5c5ef59b1b44d8a916be97d8d11493f", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: ad7c407cfe924b7a8652f8387c7f77b4 Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. Sep 23 01:46:02.521913 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': '42f0791b-92aa-41df-997a-240cb2eeb40b'} Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:46:02.523021 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. Sep 23 01:46:02.524814 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:02.526438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Returning 404 to user: Instance 42f0791b-92aa-41df-997a-240cb2eeb40b could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:46:02.526438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-97889c45-0b15-4e01-9dec-c1d686714659 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b" status: 404 len: 111 microversion: 2.1 time: 0.031482 Sep 23 01:46:02.526438 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 591/1176] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:02 2022] GET /compute/v2.1/servers/42f0791b-92aa-41df-997a-240cb2eeb40b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:46:02.846790 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:02.847438 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:02.854570 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:02.855040 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:02.855465 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:02.856178 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:02.856627 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:02.857035 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:02.994311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:03.002653 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-962e6924-ce5e-4b13-a953-d5dbae6e6979 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.159695 Sep 23 01:46:03.003250 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 586/1177] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:02 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:03.041152 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "name": "network-vif-plugged", "status": "completed", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:03.051214 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:03.052304 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:03.052760 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:03.066404 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] Creating event network-vif-plugged:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:46:03.071749 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-bb4c1939-917d-44f0-9b63-d83cc0e7a98d req-a38a04bc-f72b-4300-afaa-dd9bbe0b7388 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034547 Sep 23 01:46:03.075040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 592/1178] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:04.026694 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:04.027307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:04.033985 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:04.034441 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:04.034868 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:04.035666 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:04.036128 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:04.036549 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:04.175636 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:04.183788 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2c461b5a-65f8-41c3-bb87-511088da8e98 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.160898 Sep 23 01:46:04.184358 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 587/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:04 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:05.209879 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:05.210581 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:05.218109 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:05.219379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:05.219379 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:05.219768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:05.220202 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:05.220626 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:05.362530 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:05.370885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-0114b026-fd29-47d1-b890-2d51781e1777 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1358 microversion: 2.1 time: 0.166212 Sep 23 01:46:05.371735 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 593/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:05 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:46:06.396283 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:06.396919 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:06.404578 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.405535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.406119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.406832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.407447 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.408064 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.503257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:06.503257 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:06.511242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.512010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.512454 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.513291 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.513748 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.514183 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.541465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:46:06.569338 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:06.578119 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-afbf99be-6210-4bad-820e-d2d1b2fc626d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1548 microversion: 2.1 time: 0.187115 Sep 23 01:46:06.592018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 588/1181] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:06 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:06.662748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd592cb5-a798-4609-9b39-4fd6b3e83ac0", "tag": "52a7bbe8-2f75-4994-b4db-2f20bb798cea"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:06.672965 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.673757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.674187 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.686674 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] Creating event network-changed:52a7bbe8-2f75-4994-b4db-2f20bb798cea for instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 on hv-cinder-84914 Sep 23 01:46:06.693778 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-c8b371a7-b6bc-470f-8d69-90330bd4bec1 req-7ee394f3-bb08-4bca-99a6-884bd6c26c43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099360 Sep 23 01:46:06.694386 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 589/1182] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:06.699558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:06.700280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:06.706616 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.707102 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.707597 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.708390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.708849 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.709299 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.714998 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:06.906535 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:06.915022 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-24507582-7bdf-4170-9c67-380feb8ef8f0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1548 microversion: 2.1 time: 0.219456 Sep 23 01:46:06.916185 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 590/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:06 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1548 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:06.919716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-c807683b-59a5-495d-ba39-dd40b3a72bfc tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 204 len: 0 microversion: 2.1 time: 0.419233 Sep 23 01:46:06.919716 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 594/1184] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:46:06 2022] DELETE /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 23 01:46:06.933652 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:06.934386 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:06.940885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.941084 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:06.941461 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.941939 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.942685 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.943256 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.943719 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.946156 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:06.946936 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Searching by: {'deleted': False, 'project_id': '403b0f1ad71c459581759568e4fcd1ca'} {{(pid=121762) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 23 01:46:06.955337 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.955886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.956324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:06.957060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:06.957567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:06.958752 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:07.059313 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.multi_cell_list [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121762) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 23 01:46:07.097521 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:07.103162 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:07.109077 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-848eebe2-4225-4ead-ad3a-2ac8f2062c02 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1574 microversion: 2.1 time: 0.180283 Sep 23 01:46:07.109867 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 595/1185] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:06 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:07.166528 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-f98a85f2-d83a-48f8-b527-a43d13c9d822 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.229678 Sep 23 01:46:07.167135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 591/1186] 10.222.0.64 () {58 vars in 1125 bytes} [Fri Sep 23 01:46:06 2022] GET /compute/v2.1/servers => generated 342 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:07.179514 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:07.180154 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:07.187161 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:07.187816 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:07.188145 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:07.188860 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:07.189320 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:07.189750 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:07.323240 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:07.331459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-08b1f232-6816-448e-b38e-c2559e268bf0 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1548 microversion: 2.1 time: 0.156380 Sep 23 01:46:07.332073 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 596/1187] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:07 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:08.134812 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:08.135743 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:08.143135 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:08.143762 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:08.144265 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:08.145886 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:08.146497 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:08.147012 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:08.301166 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:08.309114 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6d521649-1095-4ecf-9b53-58fdf7b095d0 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1574 microversion: 2.1 time: 0.178635 Sep 23 01:46:08.312580 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 592/1188] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:08 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:09.195889 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd592cb5-a798-4609-9b39-4fd6b3e83ac0", "name": "network-vif-deleted", "tag": "52a7bbe8-2f75-4994-b4db-2f20bb798cea"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:09.213000 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:09.213534 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:09.214022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:09.227306 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] Creating event network-vif-deleted:52a7bbe8-2f75-4994-b4db-2f20bb798cea for instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 on hv-cinder-84914 Sep 23 01:46:09.232900 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-71b6b28d-c69f-413f-97ce-a6aed1f6a835 req-ee17043b-da50-4d28-8d86-7342a8aa6518 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045620 Sep 23 01:46:09.233502 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 597/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:09.333658 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:09.335032 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:09.342109 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:09.342588 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:09.343567 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:09.344285 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:09.344736 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:09.345152 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:09.421532 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:09.429765 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-35b0ca73-1a3b-4615-8a0e-6d5e91ba07eb tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1224 microversion: 2.1 time: 0.100231 Sep 23 01:46:09.430349 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 593/1190] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:09 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:09.449423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bd0b031-259d-4da9-9c0b-15de4a547fbf"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:09.452078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:09.459824 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:09.460326 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:09.460773 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:09.461574 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:09.461977 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:09.462412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:10.412745 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-93463e8e-991d-4b40-a8ca-1cd811b7f554 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.967444 Sep 23 01:46:10.413423 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 598/1191] 10.222.0.64 () {60 vars in 1323 bytes} [Fri Sep 23 01:46:09 2022] POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments => generated 194 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:10.458148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:10.458148 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:10.460464 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:10.461324 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:10.461767 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:10.462470 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:10.463005 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:10.463428 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:10.495908 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:10.496397 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:10.496827 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:10.497275 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lazy-loading 'fault' on Instance uuid fd592cb5-a798-4609-9b39-4fd6b3e83ac0 {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:46:10.538860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad7c407cfe924b7a8652f8387c7f77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5c5ef59b1b44d8a916be97d8d11493f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:10.546768 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-222fec3a-5a60-4e13-afbc-3503d180081f tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 200 len: 1229 microversion: 2.1 time: 0.097904 Sep 23 01:46:10.547352 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 594/1192] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:10 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:11.571418 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:11.572129 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: fd592cb5-a798-4609-9b39-4fd6b3e83ac0] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:11.579070 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:11.579567 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:11.579998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:11.580678 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:11.581216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:11.581633 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:11.596089 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] HTTP exception thrown: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Request method failure captured: Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 HTTP/1.1 Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4teQjXQY_Cjs76AnXKIqf_hPudbm4xQwxm-rdFrdBczb4Kfk30vMs9ANIrT0_tdDUsByOg_eT8a54aKcWZUELiazuZv5ggVRdGO6fmiTfSBCg9-3Unhvzs3l5lVvILgJe43nQsxOeiLuJ5aZHuMoN68n0gh-svQyvwnQRBT7GJank Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:46:11.597743 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5c5ef59b1b44d8a916be97d8d11493f", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: ad7c407cfe924b7a8652f8387c7f77b4 Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. Sep 23 01:46:11.599531 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'fd592cb5-a798-4609-9b39-4fd6b3e83ac0'} Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:46:11.601710 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. Sep 23 01:46:11.603081 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:11.604458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Returning 404 to user: Instance fd592cb5-a798-4609-9b39-4fd6b3e83ac0 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:46:11.604458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-d30c41fa-82f4-408a-baa0-6d1630bbe7a9 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0" status: 404 len: 111 microversion: 2.1 time: 0.032602 Sep 23 01:46:11.604458 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 599/1193] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:11 2022] GET /compute/v2.1/servers/fd592cb5-a798-4609-9b39-4fd6b3e83ac0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:46:12.236387 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:12.236955 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:12.243994 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:12.244479 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:12.244905 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:12.245594 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:12.246057 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:12.246456 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:12.260088 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] HTTP exception thrown: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Request method failure captured: Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 HTTP/1.1 Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ4teQjXQY_Cjs76AnXKIqf_hPudbm4xQwxm-rdFrdBczb4Kfk30vMs9ANIrT0_tdDUsByOg_eT8a54aKcWZUELiazuZv5ggVRdGO6fmiTfSBCg9-3Unhvzs3l5lVvILgJe43nQsxOeiLuJ5aZHuMoN68n0gh-svQyvwnQRBT7GJank Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:46:12.261860 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5c5ef59b1b44d8a916be97d8d11493f", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: ad7c407cfe924b7a8652f8387c7f77b4 Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.263603 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'd84ea01c-1bd5-4928-832e-e939c785fcb2'} Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:46:12.264598 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.266267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.268018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Returning 404 to user: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:46:12.268018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-e2a38e72-4d64-4980-b3f6-e236f0bcd304 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 404 len: 111 microversion: 2.1 time: 0.030911 Sep 23 01:46:12.268018 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 595/1194] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:46:12 2022] DELETE /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 23 01:46:12.272254 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:12.272862 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] [instance: d84ea01c-1bd5-4928-832e-e939c785fcb2] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:12.278929 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:12.279409 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:12.279874 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:12.280566 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:12.281020 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:12.281446 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:12.296190 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.wsgi [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] HTTP exception thrown: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Request method failure captured: Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: request: GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 HTTP/1.1 Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept: application/json Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Accept-Encoding: identity Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Connection: close Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Length: 0 Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Content-Type: application/json Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Host: 10.222.0.64 Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Openstack-System-Scope: None Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: User-Agent: python-urllib3/1.26.12 Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Auth-Token: gAAAAABjLQ4teQjXQY_Cjs76AnXKIqf_hPudbm4xQwxm-rdFrdBczb4Kfk30vMs9ANIrT0_tdDUsByOg_eT8a54aKcWZUELiazuZv5ggVRdGO6fmiTfSBCg9-3Unhvzs3l5lVvILgJe43nQsxOeiLuJ5aZHuMoN68n0gh-svQyvwnQRBT7GJank Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Id: None Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Domain-Name: None Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Identity-Status: Confirmed Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Is-Admin-Project: True Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Id: default Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Domain-Name: Default Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Project-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Role: member,reader Sep 23 01:46:12.297746 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Roles: member,reader Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f5c5ef59b1b44d8a916be97d8d11493f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f5c5ef59b1b44d8a916be97d8d11493f", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Id: f5c5ef59b1b44d8a916be97d8d11493f Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-Tenant-Name: tempest-TestVolumeBootPattern-9221964 Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Id: default Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Domain-Name: Default Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Id: ad7c407cfe924b7a8652f8387c7f77b4 Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: X-User-Name: tempest-TestVolumeBootPattern-9221964-project Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: method: > Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: exception: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.299540 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: action_args: {'id': 'd84ea01c-1bd5-4928-832e-e939c785fcb2'} Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:46:12.300622 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. Sep 23 01:46:12.302789 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: ERROR nova.api.openstack.wsgi Sep 23 01:46:12.304412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Returning 404 to user: Instance d84ea01c-1bd5-4928-832e-e939c785fcb2 could not be found. {{(pid=121763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:46:12.304412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-03fb2e24-9720-4093-9e02-9da7fb52aa90 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2" status: 404 len: 111 microversion: 2.1 time: 0.030720 Sep 23 01:46:12.304412 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 600/1195] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:12 2022] GET /compute/v2.1/servers/d84ea01c-1bd5-4928-832e-e939c785fcb2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:46:13.893336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-87cc7a84-4d00-4750-949d-299b2d598a55 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] Calling method '.version_select at 0x7f76793dc040>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:13.980894 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-87cc7a84-4d00-4750-949d-299b2d598a55 tempest-TestVolumeBootPattern-9221964 tempest-TestVolumeBootPattern-9221964-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-277631498" status: 202 len: 0 microversion: 2.1 time: 0.091368 Sep 23 01:46:13.981483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 596/1196] 10.222.0.64 () {58 vars in 1260 bytes} [Fri Sep 23 01:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-277631498 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:46:18.043763 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:18.044352 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:18.048206 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:18.052346 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:18.052839 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:18.053278 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:18.054542 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:18.054997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:18.055425 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:18.278744 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:18.288004 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f0348553-d1bf-4eb5-bcb8-29884009ab12 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1594 microversion: 2.1 time: 0.248172 Sep 23 01:46:18.289082 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 601/1197] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:18 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1594 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:20.927085 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:20.941094 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell0:SELECT=2 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:20.942307 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:20.944596 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:20.945184 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:20.946112 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:20.961976 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.compute.server_external_events [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] Creating event network-changed:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:46:20.968236 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [req-20be6ed5-2f34-4a5e-b275-d6dbc1bd4e4b req-0bfc04b5-28b1-4a98-bbd4-08e453e89c89 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045521 Sep 23 01:46:20.969435 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 597/1198] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:24.366695 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-490770488"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:24.367242 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:24.374128 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:24.384452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:24.384452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:24.384452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:24.384452 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:24.385258 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:24.516282 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.network.security_group_api [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Adding security group 7bfb0660-589c-4325-a424-03a254b2ee21 to port 7afe16a6-56a4-4780-bdd2-0c90cc6040f5 Sep 23 01:46:24.982753 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-caebd625-67d9-422b-9342-e4f4c194df20 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action" status: 202 len: 0 microversion: 2.1 time: 0.620313 Sep 23 01:46:24.986371 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 602/1199] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:46:24 2022] POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:46:24.993145 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:24.993904 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:24.994661 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:25.002432 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:25.003069 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:25.003216 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:25.003639 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:25.003792 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:25.004079 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:25.004728 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:25.005242 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:25.005757 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:25.030116 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] Creating event network-changed:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:46:25.037593 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-fcf30573-5a26-4f18-ad97-dde0d9f373ea req-d225456d-bd9c-4809-aeec-0ec5b9915531 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047884 Sep 23 01:46:25.038885 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 603/1200] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:46:25.213926 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:25.225489 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-2c805cae-3bdd-4c7c-af1d-0ca897f0c891 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1759 microversion: 2.1 time: 0.235337 Sep 23 01:46:25.226986 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 598/1201] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:24 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1759 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:39.191125 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:39.195677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:46:39.198512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:39.205209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:39.205692 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:39.206126 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:39.206819 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:39.207265 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:39.207730 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:39.474187 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-072f57c7-faa5-4018-a237-4dbe7858ec95 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action" status: 202 len: 0 microversion: 2.1 time: 0.284223 Sep 23 01:46:39.474980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 604/1202] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:46:39 2022] POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:46:39.484195 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:39.484698 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:39.486964 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=42 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:46:39.492153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:39.496874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:39.496874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:39.496874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:39.496874 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:39.497287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:39.641993 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:39.650449 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0e85e1c0-7c93-436b-ba67-5ba3304a5130 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1751 microversion: 2.1 time: 0.171200 Sep 23 01:46:39.651041 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 599/1203] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:39 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:40.674625 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:40.675339 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:40.682166 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:40.682644 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:40.683076 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:40.683800 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:40.684250 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:40.684675 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:40.833980 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:40.842369 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1a75899c-75ec-4701-a64c-7cb691a71c3e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.172634 Sep 23 01:46:40.842933 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 605/1204] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:40 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:41.866455 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:41.867062 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:41.873671 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:41.874153 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:41.874586 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:41.875289 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:41.875763 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:41.876318 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:42.022390 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:42.031856 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d72acd6d-2a64-43dd-86e2-5fba1fe769b8 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.169305 Sep 23 01:46:42.035593 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 600/1205] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:41 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:43.057766 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:43.058434 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:43.064981 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:43.065469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:43.065908 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:43.066608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:43.067065 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:43.067492 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:43.218983 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:43.228010 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-f1024f18-ef95-4abe-b4c8-f28ae1766d3f tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.174687 Sep 23 01:46:43.229186 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 606/1206] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:43 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:44.253897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:44.253897 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:44.261139 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:44.262824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:44.262824 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:44.263063 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:44.263316 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:44.263769 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:44.411225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:44.419359 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-9309e61c-c38d-4b44-91bd-3f749251678e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.170176 Sep 23 01:46:44.419944 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 601/1207] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:44 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:45.442881 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:45.443487 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:45.450123 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:45.450616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:45.451046 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:45.451781 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:45.452237 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:45.452661 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:45.644209 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:45.653536 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-16a359ae-dfff-443d-bd4e-b3fa9a586ce7 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.214576 Sep 23 01:46:45.654100 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 607/1208] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:45 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:46.677672 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:46.678280 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:46.684794 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:46.685267 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:46.685700 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:46.686382 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:46.686828 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:46.687245 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:46.828403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:46.836729 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d632bea0-9838-4c3b-a76b-31097c6cc6b2 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.162982 Sep 23 01:46:46.837306 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 602/1209] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:46 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:47.861774 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:47.862367 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:47.869169 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:47.869646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:47.870087 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:47.870779 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:47.871232 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:47.871722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:48.017159 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:48.025592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9773b7cd-49ad-4330-be45-d716f136c627 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.167704 Sep 23 01:46:48.026148 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 608/1210] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:47 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:46:49.049402 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:49.050037 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:49.056810 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:49.057287 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:49.057714 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:49.058401 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:49.058846 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:49.059261 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:49.208015 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:49.216403 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-0415128c-d894-4134-bfe3-3dd3f01c8916 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.170846 Sep 23 01:46:49.217067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 603/1211] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:49 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 23 01:46:50.241440 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:50.242074 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:50.249091 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:50.249562 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:50.249997 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:50.250677 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:50.251122 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:50.251541 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:50.395978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:50.404448 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-1224836c-2cf0-405b-81c5-534e968d4409 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.166970 Sep 23 01:46:50.405023 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 609/1212] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:50 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:51.427971 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:51.428629 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:51.435216 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:51.435733 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:51.436165 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:51.436853 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:51.437311 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:51.437724 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:51.592264 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:51.600802 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dde95b1a-2e68-4e0c-8b20-9e41e3ed8310 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1756 microversion: 2.1 time: 0.176869 Sep 23 01:46:51.601495 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 604/1213] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:51 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:46:52.624611 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:46:52.625249 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:46:52.631893 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:52.632377 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:52.632816 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:52.633515 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:46:52.633971 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:46:52.634422 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:46:52.782569 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:46:52.790940 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-e968a1f7-af44-4ead-81cb-0ed69cb87498 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1759 microversion: 2.1 time: 0.170265 Sep 23 01:46:52.791518 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 610/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:46:52 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:47:25.168483 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-490770488"}} {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:47:25.169154 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:25.171197 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_api:SELECT=15 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:47:25.171913 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG dbcounter [-] [121762] Writing DB stats nova_cell1:SELECT=36 {{(pid=121762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:47:25.172770 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:47:25.172903 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Fri Sep 23 01:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action (ip 10.222.0.64) !!! Sep 23 01:47:25.180031 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:25.190213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:25.190213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:25.190213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:25.190213 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:25.190654 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:25.318612 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.network.security_group_api [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Removing security group 7bfb0660-589c-4325-a424-03a254b2ee21 from port 7afe16a6-56a4-4780-bdd2-0c90cc6040f5 Sep 23 01:47:25.677383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-c3ad4191-2c9b-4b5a-8d4b-9512208f7aeb tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action" status: 202 len: 0 microversion: 2.1 time: 0.513399 Sep 23 01:47:25.678006 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 605/1215] 10.222.0.64 () {60 vars in 1278 bytes} [Fri Sep 23 01:47:25 2022] POST /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:47:25.687517 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:47:25.697040 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_api:SELECT=19 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:47:25.697768 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG dbcounter [-] [121763] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 23 01:47:25.698725 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 23 01:47:25.698865 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: Fri Sep 23 01:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.64) !!! Sep 23 01:47:25.701529 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:25.702171 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:25.702608 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:25.718866 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] Creating event network-changed:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:47:25.724941 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-3b842d48-a647-4cb3-82d8-45de92814289 req-45bafcda-a207-44e1-9d3a-9332bfd005f6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041262 Sep 23 01:47:25.725592 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 611/1216] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:47:26.915822 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:26.916459 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:26.919602 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:47:26.925474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:26.926320 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:26.926832 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:26.927634 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:26.928331 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:26.929016 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:26.931024 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:26.931902 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:26.932573 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:26.944548 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] Creating event network-changed:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:47:26.950731 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-45266a16-c513-4ba8-af5f-01cc8caf600d req-cb4e60b0-32a0-4272-91e9-9cf25505aff0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037287 Sep 23 01:47:26.951722 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 612/1217] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:47:27.020766 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.objects.instance [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lazy-loading 'services' on Instance uuid c936335f-541e-469a-bca1-551a78b1891a {{(pid=121762) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:47:27.252383 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-dade6a4b-bf89-4132-a0b8-397b389dad4a tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments/0bd0b031-259d-4da9-9c0b-15de4a547fbf" status: 202 len: 0 microversion: 2.1 time: 0.341718 Sep 23 01:47:27.256702 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 606/1218] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:47:26 2022] DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments/0bd0b031-259d-4da9-9c0b-15de4a547fbf => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 23 01:47:27.264144 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:27.266688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:27.274207 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:27.274706 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:27.275141 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:27.275872 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:27.276638 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:27.277066 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:27.314147 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-25695995-a929-427d-8cbb-a338d9d8ffbe tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055933 Sep 23 01:47:27.319680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 613/1219] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:47:27 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:47:28.327304 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:28.329709 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:28.336643 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:28.337122 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:28.337558 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:28.338262 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:28.338719 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:28.339144 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:28.373326 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-50fa6cf3-157f-4bec-b8b0-229ed9554a2b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050527 Sep 23 01:47:28.374127 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 607/1220] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:47:28 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 23 01:47:29.386724 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:29.388923 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:29.395601 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:29.396083 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:29.396512 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:29.397199 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:29.397646 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:29.398064 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:29.428136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-53270dd3-5198-4a3b-9c05-b80e61d522e5 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045765 Sep 23 01:47:29.428688 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 614/1221] 10.222.0.64 () {58 vars in 1302 bytes} [Fri Sep 23 01:47:29 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 23 01:47:29.439422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:29.439995 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:29.446572 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:29.447067 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:29.447501 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:29.448225 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:29.448678 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:29.449100 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:29.525516 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] HTTP exception thrown: Instance c936335f-541e-469a-bca1-551a78b1891a is not attached to volume 0bd0b031-259d-4da9-9c0b-15de4a547fbf Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Request method failure captured: Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments/0bd0b031-259d-4da9-9c0b-15de4a547fbf HTTP/1.1 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ-zXu3vNn0JQZORAnA8hemPALdXYRc8n5AvWgEssIJOLb1FOGjIf7baROsPkmvAUrJWOWnV4OpbPP8dHLso-jVDXpkzRneYdG8jlVuwzmRbBjkY1yKGwONP1Tjrft3_DA5gdSoarROx4QAH1Z7mFl724KQxpB_9_TCtc957ND22Kc0 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 403b0f1ad71c459581759568e4fcd1ca Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:47:29.527933 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_403b0f1ad71c459581759568e4fcd1ca", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 403b0f1ad71c459581759568e4fcd1ca Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-TestMinimumBasicScenario-208858695-project Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 0857c0af9c944a2fb6e75c7297945fc0 Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-TestMinimumBasicScenario-208858695-project Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:47:29.529744 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance c936335f-541e-469a-bca1-551a78b1891a is not attached to volume 0bd0b031-259d-4da9-9c0b-15de4a547fbf Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'server_id': 'c936335f-541e-469a-bca1-551a78b1891a', 'id': '0bd0b031-259d-4da9-9c0b-15de4a547fbf'} Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0bd0b031-259d-4da9-9c0b-15de4a547fbf. Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:47:29.530823 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936335f-541e-469a-bca1-551a78b1891a is not attached to volume 0bd0b031-259d-4da9-9c0b-15de4a547fbf Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936335f-541e-469a-bca1-551a78b1891a is not attached to volume 0bd0b031-259d-4da9-9c0b-15de4a547fbf Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:29.532613 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Returning 404 to user: Instance c936335f-541e-469a-bca1-551a78b1891a is not attached to volume 0bd0b031-259d-4da9-9c0b-15de4a547fbf {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:47:29.534011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-d3c2230f-6473-4f31-8d45-22a784f6187b tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments/0bd0b031-259d-4da9-9c0b-15de4a547fbf" status: 404 len: 154 microversion: 2.1 time: 0.094032 Sep 23 01:47:29.534011 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 608/1222] 10.222.0.64 () {58 vars in 1416 bytes} [Fri Sep 23 01:47:29 2022] DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a/os-volume_attachments/0bd0b031-259d-4da9-9c0b-15de4a547fbf => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:47:30.795334 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:30.795962 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:30.802456 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:30.802928 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:30.803441 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:30.804157 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:30.804604 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:30.805022 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:30.830904 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Going to try to terminate instance {{(pid=121763) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 23 01:47:31.086078 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-54574a7a-37ba-4f41-9026-c190aed0d258 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 204 len: 0 microversion: 2.1 time: 0.295125 Sep 23 01:47:31.086594 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 615/1223] 10.222.0.64 () {58 vars in 1239 bytes} [Fri Sep 23 01:47:30 2022] DELETE /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 23 01:47:31.095411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:31.097060 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:31.102939 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:31.103415 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:31.103891 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:31.104562 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:31.105172 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:31.105593 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:31.237001 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:47:31.245354 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-a252d7fe-7df1-49dd-8bfa-1dec28e02292 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1554 microversion: 2.1 time: 0.153790 Sep 23 01:47:31.249163 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 609/1224] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:47:31 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:47:32.269419 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:32.270108 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:32.277094 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:32.277648 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:32.278090 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:32.278795 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:32.279252 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:32.279708 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:32.416664 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:47:32.424381 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-50519ac1-392d-4c10-bc10-994d7fe52545 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1554 microversion: 2.1 time: 0.159247 Sep 23 01:47:32.424937 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 616/1225] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:47:32 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:47:33.447915 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:33.448507 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:33.455748 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:33.459411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:33.459411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:33.459411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:33.459411 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:33.459907 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:33.657680 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c936335f-541e-469a-bca1-551a78b1891a", "name": "network-vif-deleted", "tag": "7afe16a6-56a4-4780-bdd2-0c90cc6040f5"}]} {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 23 01:47:33.668615 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:33.674179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:33.674179 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:33.681637 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.compute.server_external_events [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] Creating event network-vif-deleted:7afe16a6-56a4-4780-bdd2-0c90cc6040f5 for instance c936335f-541e-469a-bca1-551a78b1891a on hv-cinder-84914 Sep 23 01:47:33.684076 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.policy [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121762) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:47:33.687477 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [req-3a20a39d-ac1a-448b-94be-8a18ae907d5c req-ecafd510-0840-409d-a8dc-e71974ca154a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033507 Sep 23 01:47:33.688132 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 617/1226] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Sep 23 01:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 23 01:47:33.692336 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-5dbb173b-9e6a-47d4-945c-d08531aece4d tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1554 microversion: 2.1 time: 0.248508 Sep 23 01:47:33.692912 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 610/1227] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:47:33 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:47:34.717616 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:34.718315 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.compute.api [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121763) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:34.725062 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:34.725554 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:34.725998 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:34.726695 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:34.727403 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:34.727864 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:34.759459 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:34.759978 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:34.760421 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG oslo_concurrency.lockutils [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:34.760876 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.objects.instance [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lazy-loading 'fault' on Instance uuid c936335f-541e-469a-bca1-551a78b1891a {{(pid=121763) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 23 01:47:34.803101 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.policy [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0857c0af9c944a2fb6e75c7297945fc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '403b0f1ad71c459581759568e4fcd1ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121763) authorize /opt/stack/nova/nova/policy.py:199}} Sep 23 01:47:34.810549 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-918df101-eeff-40b3-ae54-30c1b9c5a63e tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 200 len: 1348 microversion: 2.1 time: 0.097855 Sep 23 01:47:34.811136 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 618/1228] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:47:34 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 23 01:47:35.838504 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '>' {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:35.839115 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.compute.api [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] [instance: c936335f-541e-469a-bca1-551a78b1891a] Fetching instance by UUID {{(pid=121762) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 23 01:47:35.845937 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:35.846422 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:35.846858 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:35.847568 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Acquiring lock "365480e9-a6c8-4545-aa74-07b831267c7c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 23 01:47:35.848027 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 23 01:47:35.848453 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG oslo_concurrency.lockutils [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Lock "365480e9-a6c8-4545-aa74-07b831267c7c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 23 01:47:35.861934 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.wsgi [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] HTTP exception thrown: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Request method failure captured: Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: request: GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a HTTP/1.1 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept: application/json Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Accept-Encoding: identity Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Connection: close Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Length: 0 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Content-Type: application/json Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Host: 10.222.0.64 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: Openstack-System-Scope: None Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: User-Agent: python-urllib3/1.26.12 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Auth-Token: gAAAAABjLQ-zXu3vNn0JQZORAnA8hemPALdXYRc8n5AvWgEssIJOLb1FOGjIf7baROsPkmvAUrJWOWnV4OpbPP8dHLso-jVDXpkzRneYdG8jlVuwzmRbBjkY1yKGwONP1Tjrft3_DA5gdSoarROx4QAH1Z7mFl724KQxpB_9_TCtc957ND22Kc0 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Id: None Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Domain-Name: None Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Identity-Status: Confirmed Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Is-Admin-Project: True Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Id: default Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Domain-Name: Default Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Id: 403b0f1ad71c459581759568e4fcd1ca Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Project-Name: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Role: member,reader Sep 23 01:47:35.863474 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Roles: member,reader Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/403b0f1ad71c459581759568e4fcd1ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_403b0f1ad71c459581759568e4fcd1ca", "adminURL": "http://10.222.0.64:8080"}]}] Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Id: 403b0f1ad71c459581759568e4fcd1ca Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-Tenant-Name: tempest-TestMinimumBasicScenario-208858695 Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User: tempest-TestMinimumBasicScenario-208858695-project Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Id: default Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Domain-Name: Default Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Id: 0857c0af9c944a2fb6e75c7297945fc0 Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: X-User-Name: tempest-TestMinimumBasicScenario-208858695-project Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: method: > Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: exception: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. Sep 23 01:47:35.865168 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: action_args: {'id': 'c936335f-541e-469a-bca1-551a78b1891a'} Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: {{(pid=121762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 23 01:47:35.866086 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. Sep 23 01:47:35.868252 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: ERROR nova.api.openstack.wsgi Sep 23 01:47:35.870842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: DEBUG nova.api.openstack.wsgi [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Returning 404 to user: Instance c936335f-541e-469a-bca1-551a78b1891a could not be found. {{(pid=121762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 23 01:47:35.870842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: INFO nova.api.openstack.requestlog [None req-6bbc463f-820b-4258-959f-f8f962350bd9 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a" status: 404 len: 111 microversion: 2.1 time: 0.030288 Sep 23 01:47:35.870842 dv-cinder-849143-7-iscsi devstack@n-api.service[121762]: [pid: 121762|app: 0|req: 611/1229] 10.222.0.64 () {58 vars in 1236 bytes} [Fri Sep 23 01:47:35 2022] GET /compute/v2.1/servers/c936335f-541e-469a-bca1-551a78b1891a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 23 01:47:35.875469 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: DEBUG nova.api.openstack.wsgi [None req-9c2b96aa-da13-4931-83c4-e51ce8df1550 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] Calling method '.version_select at 0x7f76791aa280>' {{(pid=121763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 23 01:47:35.984465 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: INFO nova.api.openstack.requestlog [None req-9c2b96aa-da13-4931-83c4-e51ce8df1550 tempest-TestMinimumBasicScenario-208858695 tempest-TestMinimumBasicScenario-208858695-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1137466195" status: 202 len: 0 microversion: 2.1 time: 0.114046 Sep 23 01:47:35.985032 dv-cinder-849143-7-iscsi devstack@n-api.service[121763]: [pid: 121763|app: 0|req: 619/1230] 10.222.0.64 () {58 vars in 1272 bytes} [Fri Sep 23 01:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1137466195 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)